-- Logs begin at Thu 2022-06-16 17:45:57 UTC, end at Thu 2022-06-16 19:17:45 UTC. -- Jun 16 18:47:11.763969 dv-cinder-846171-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 18:47:11.773059 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 18:47:11.775036 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 18:47:11 2022] *** Jun 16 18:47:11.775036 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 18:47:11.775036 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 18:47:11.775036 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: nodename: dv-cinder-846171-1-iscsi Jun 16 18:47:11.775036 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: machine: x86_64 Jun 16 18:47:11.775036 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: clock source: unix Jun 16 18:47:11.775036 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: pcre jit disabled Jun 16 18:47:11.775036 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: detected number of CPU cores: 4 Jun 16 18:47:11.775036 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: current working directory: / Jun 16 18:47:11.775036 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: detected binary path: /usr/bin/uwsgi-core Jun 16 18:47:11.775747 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: your processes number limit is 47680 Jun 16 18:47:11.775747 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: your memory page size is 4096 bytes Jun 16 18:47:11.775747 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: detected max file descriptor number: 2048 Jun 16 18:47:11.775747 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: lock engine: pthread robust mutexes Jun 16 18:47:11.775747 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: thunder lock: enabled Jun 16 18:47:11.775747 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 18:47:11.775747 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 18:47:11.818634 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: Python main interpreter initialized at 0x56105af579c0 Jun 16 18:47:11.818634 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: python threads support enabled Jun 16 18:47:11.818634 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: your server socket listen backlog is limited to 100 connections Jun 16 18:47:11.818634 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: your mercy for graceful operations on workers is 90 seconds Jun 16 18:47:11.818989 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 18:47:11.819066 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: *** Operational MODE: preforking *** Jun 16 18:47:11.819303 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: *** uWSGI is running in multiple interpreter mode *** Jun 16 18:47:11.819303 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: spawned uWSGI master process (pid: 115450) Jun 16 18:47:11.819503 dv-cinder-846171-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 18:47:11.820027 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: spawned uWSGI worker 1 (pid: 115451, cores: 1) Jun 16 18:47:11.820362 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: spawned uWSGI worker 2 (pid: 115452, cores: 1) Jun 16 18:47:11.820541 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 18:47:12.487113 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:47:12.487696 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:47:13.658499 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:47:13.658499 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: from cryptography.utils import int_from_bytes Jun 16 18:47:13.659184 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:47:13.659184 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: from cryptography.utils import int_from_bytes Jun 16 18:47:13.664856 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:47:13.664856 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: from cryptography.utils import int_from_bytes Jun 16 18:47:13.665302 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:47:13.665302 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: from cryptography.utils import int_from_bytes Jun 16 18:47:16.233198 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:47:16.233810 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:47:16.233907 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:47:16.233907 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:47:16.234333 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:47:16.234333 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:47:16.234498 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:47:16.234582 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:47:16.234771 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:47:16.235447 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.235632 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:47:16.235777 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.236026 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.236122 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.236356 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.236447 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.236682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.236772 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.236997 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.237089 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.237339 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.237448 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.237655 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.237746 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.237975 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.238096 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.238218 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.238309 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.238533 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.238654 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.238844 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846171-1-iscsi {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.238947 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.239155 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.239247 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.239455 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.239556 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846171-1-iscsi {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.239759 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.239858 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.240079 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.240182 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.240380 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.240493 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.240697 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.240803 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.240994 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.241088 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.241335 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.241514 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.241627 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.242766 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.242919 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.243062 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.243179 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.243306 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.243436 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.243564 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.243690 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.243819 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.243939 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.244063 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.244194 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.244321 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.244451 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.244581 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.244707 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.244826 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.244956 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.245086 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.245212 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.245370 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846171-1-iscsi {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.245507 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.245634 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.245761 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846171-1-iscsi {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.245886 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.246006 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.246131 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.246262 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.246391 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.246519 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.246658 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.246820 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.246944 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.247131 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.247264 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.247444 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.247579 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.247744 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.247867 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.248062 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.248203 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.248374 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.248496 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.248683 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.248817 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.248996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.249151 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.249313 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.249439 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.249618 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.249750 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.249919 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.250051 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.250256 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.250385 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.251172 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.251308 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.251442 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.251573 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.251702 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.251832 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.251953 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.252079 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.252236 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.252361 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.252543 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.252672 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.252854 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.253067 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.253196 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.253353 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.253475 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.253607 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.253737 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.253867 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.253997 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.254125 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.254252 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.254372 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.254528 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.254653 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.254828 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.254952 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.255127 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.255250 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.255427 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.255557 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.255732 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.255863 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.256030 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.256161 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.256329 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.256452 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.256630 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.256759 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.256937 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.257078 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.257263 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.257402 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.257571 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.257702 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.257884 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.258020 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.258197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.258326 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.258506 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.258639 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.258807 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.258938 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.259139 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.259270 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.259445 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.259576 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.259743 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.259877 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.260056 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.260190 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.260391 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.260528 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.260668 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.260799 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.260953 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.261086 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.261310 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.261443 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.261576 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.261714 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.261890 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.262022 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.262188 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.262319 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.262448 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.262568 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.262716 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.262846 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.263014 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.263148 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.263325 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.263456 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.263624 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.263754 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.263925 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.264058 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.264225 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.264350 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.264520 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.264650 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.264818 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.264954 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.265117 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.265257 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.265438 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.265561 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.265742 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.265876 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.266041 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.266188 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.266366 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.266490 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.266670 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.266803 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.266967 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.267099 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.267265 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.267395 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.267567 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.267700 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.267872 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.267996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.268172 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.268303 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.268471 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.268601 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.268771 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.268907 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.269070 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.269194 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.269416 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.269540 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.269693 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.269816 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.269992 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.270117 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.270299 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.270448 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.270642 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.270772 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.270899 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.271019 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.271178 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.271309 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.271512 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.271637 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.271756 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.271875 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.272057 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.272188 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.272353 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.272477 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.272653 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.272778 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.272957 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.273087 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.273271 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.273397 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.273574 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.273698 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.273872 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.273996 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.274169 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.274299 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.274465 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.274601 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.274763 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.274897 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.275058 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.275189 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.275354 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.275486 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.275654 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.275782 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.275957 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.276081 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.276256 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.276389 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.276555 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.276684 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.276854 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.276978 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.277152 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.277307 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.277490 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.277612 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.277799 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.277950 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.278125 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:47:16.278261 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.278456 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.278580 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.278766 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.278890 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.279086 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.279208 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.279401 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.279530 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.279714 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.279837 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.280020 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.280155 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.280326 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.280457 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.280679 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.280820 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.280941 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.281061 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.281233 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.281405 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.281542 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.281771 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.281899 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.282027 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.282183 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.282314 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.282505 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.282656 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.282815 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.282940 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.283127 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.283258 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.283439 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.283575 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.283743 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.283867 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.284051 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.284183 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.284360 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.284490 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.284671 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.284793 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.284975 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.285106 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.285325 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.285470 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.285640 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.285764 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.285961 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.286084 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.286282 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.286419 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.286596 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.286755 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.286903 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.287028 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.287209 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.287334 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.287514 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.287646 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.287807 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.287930 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.288120 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.288258 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.288433 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.288555 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.288745 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.288902 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.289042 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.289164 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.289366 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.289495 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.289672 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.289796 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.289966 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.290090 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.290268 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.290402 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.290580 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.290732 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.290918 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.291051 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.291179 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.291298 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.291481 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.291619 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.291816 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.291945 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.292123 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.292256 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.292441 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.292579 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.292755 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.292880 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.293056 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.293213 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.293383 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.293521 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.293683 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.293807 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.293988 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.294110 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.294285 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.294420 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.294593 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.294717 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.294898 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.295035 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.295200 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.295323 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.295534 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.295663 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.295833 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.295956 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.296140 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.296265 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.296446 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.296569 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.296751 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.296876 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.297052 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.297176 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.297893 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.298020 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.298205 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.298330 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.298524 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.298649 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.298837 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.298969 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.299142 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.299279 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.299445 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.299570 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.299760 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.299882 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.300060 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.300190 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.300362 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.300499 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.300673 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.300806 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.301014 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.301153 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.301293 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.301428 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.301592 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.301716 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.301921 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.302135 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.302259 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.302379 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.302497 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.302630 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.302803 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.302934 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.303131 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.303252 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.303449 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.303590 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.303747 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.303872 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.304066 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.304206 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.304387 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.304510 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.304698 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.304823 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.304997 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.305120 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.305325 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.305452 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.305627 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.305753 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.305934 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.306064 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.306235 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.306368 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.306539 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.306668 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.306836 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.306966 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.307140 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.307274 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.307439 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.307560 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.307737 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.307866 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.308037 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.308169 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.308340 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.308469 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.308644 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.308765 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.308944 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.309077 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.309264 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.309393 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.309564 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.309689 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.309866 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.309989 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.310171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.310293 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.310513 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.310635 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.310822 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.310944 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.311152 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.311282 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.311458 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.311627 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.311759 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.311880 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.312078 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.312217 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.312365 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.312496 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.312672 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.312797 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.312998 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.313652 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.313899 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.314036 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.314216 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.314339 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.314532 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.314656 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.314849 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.314979 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.315159 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.315289 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.315479 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.315602 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.315788 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.315920 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.316112 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.316234 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.316411 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.316539 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.316725 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.316857 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.317031 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.317152 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.317374 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.317512 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.317699 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.317832 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.318019 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.318149 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.318327 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.318450 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.318639 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.318764 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.318945 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.319068 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.319252 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.319374 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.319560 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.319692 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.319866 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.319998 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.320176 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.320297 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.320483 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.320611 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.320798 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.320921 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.321105 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.321260 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.321465 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.321596 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.321739 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.321868 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.322053 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.322265 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.322398 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.322518 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.322637 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.322755 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.322961 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.323094 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.323273 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.323394 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.323583 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.323703 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.323890 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.324026 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.324207 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.324330 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.324514 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.324636 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.324819 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.324953 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.325124 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.325288 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.325451 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.325577 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.325753 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.325878 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.326059 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.326183 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.326366 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.326487 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.326671 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.326797 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.326976 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.327101 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.327276 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.327399 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.327586 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.327708 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.327886 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.328008 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.328188 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.328313 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.328489 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.328634 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.328822 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.328953 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.329139 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.329304 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.329471 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.329602 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.329788 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.329912 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.330104 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.330241 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.330406 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.330536 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.330706 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.330837 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.331025 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.331224 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.331347 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.331490 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.331676 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.331800 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.331926 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.332058 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.332178 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.332374 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.332507 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.332628 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.332807 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.332939 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.333108 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.333233 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.333446 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.333570 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.333763 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.333888 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.334068 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.334190 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.334378 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.334507 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.334685 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.334809 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.334991 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.335114 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.335301 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.335422 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.335613 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.335745 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.335919 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.336039 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.336228 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.336350 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.336536 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.336661 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.336844 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.336967 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.337152 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.337304 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.337487 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.337610 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.337793 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.337914 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.338103 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.338234 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.338413 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.338535 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.338711 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.338841 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.339020 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.339159 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.339324 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.339446 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.339639 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.339885 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.340015 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.340220 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.340508 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.340632 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.340838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.340960 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.341155 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.341335 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.341494 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.341603 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.341815 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.341930 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.342140 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.342253 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.342474 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.342596 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.342779 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.342901 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.343092 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.343214 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.343399 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.343522 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.343701 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.343813 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.344012 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.344135 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.344340 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.344454 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.344644 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.344755 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.344948 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.345057 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.345270 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.345385 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.345570 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.345692 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.345873 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.345983 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.346174 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.346282 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.346472 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.346608 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.346774 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.346890 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.347074 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.347198 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.347383 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.347513 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.347683 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.347819 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.348239 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.348366 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.348553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.348674 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.348855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.348990 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.349157 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.349289 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.349480 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.349604 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.349793 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.349920 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.350098 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.350222 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.350428 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.350551 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.350735 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.350858 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.351073 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.351204 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.351373 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.351503 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.351677 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.351814 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.352001 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.352124 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.352285 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.352410 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.352615 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.352746 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.352866 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.352984 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.353174 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.353337 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.353502 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.353628 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.353801 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.353925 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.354110 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.354242 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.354412 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.354542 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.354716 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.354838 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.355023 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.355225 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.355348 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.355468 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.355616 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.355745 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.355919 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.356051 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.356230 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.356353 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.356534 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.356657 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.356829 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.356959 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.357129 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.357272 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.357459 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.357594 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.357764 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.357889 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.358062 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.358186 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.358733 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.358859 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.358859 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.359064 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.359166 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.359267 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.359367 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.359468 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.359578 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.359682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.359815 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.360409 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.360630 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.360748 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.360936 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.361047 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.361265 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.361397 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.363338 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.364058 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.364195 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.364322 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.364322 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.364563 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.364695 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.364818 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.364940 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.365076 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.365199 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.365363 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.365496 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.365619 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.365747 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.365874 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.365997 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.366124 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.366253 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.366375 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.366494 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.366604 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.366722 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.366841 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.366974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.367087 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.367205 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.367325 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.367444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.367577 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.367699 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.367818 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.367938 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.368065 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.368187 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.368316 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.368437 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.368564 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.368686 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.368805 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.368925 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.369053 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.369183 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.369319 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.369440 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.369560 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.369680 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.369812 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.369940 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.370060 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.370189 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.370311 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.370439 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.370561 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.370681 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.370800 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.370920 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.371039 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.371167 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.371289 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.371410 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.371529 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.371652 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.371783 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.371913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.372034 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.372154 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.372273 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.372393 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.372512 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.372644 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.372765 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.372891 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.373018 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.373139 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.373456 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.373598 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.373721 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.373848 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.373969 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.374095 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.374224 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.374345 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.374473 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.374593 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.374721 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.374842 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.374974 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.375102 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.375223 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.375351 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.375473 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.376168 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.376299 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.376430 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.376552 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.376679 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.376806 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.376935 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.377055 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.377172 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.377308 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.377430 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.377551 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.377683 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.377805 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.377926 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.378088 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.378213 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.378333 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.378461 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.378584 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.378711 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.378832 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.378952 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.379119 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.379254 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.379428 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.379550 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.379734 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.379859 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.380035 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.380168 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.380346 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.380469 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.380650 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.380774 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.380953 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.381085 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.381282 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.381412 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.381579 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.381712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.381886 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.382013 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.382183 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.382305 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.382487 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.382609 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.382800 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.382924 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.383104 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.383228 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.383553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.383764 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.383897 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.384017 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.384135 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.384254 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.384372 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.384499 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.384662 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.384795 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.384963 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.385096 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.385340 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.385477 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.385659 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.385783 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.385966 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.386088 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.386278 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.386408 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.386583 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.386706 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.386884 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.387008 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.387188 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.387324 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.387506 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.387637 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.387806 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.387928 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.388105 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.388229 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.388404 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.388526 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.388721 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.388843 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.389022 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.389154 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.389362 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.389498 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.389684 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.389805 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.389993 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.390117 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.390317 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.390447 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.390734 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.390865 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.391044 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.391200 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.391372 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.391495 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.391691 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.391826 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.392007 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.392129 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.392322 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.392453 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.392623 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.392754 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.392998 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.393120 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.393358 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.393492 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.393749 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.393872 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.393992 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.394185 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.394310 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.394431 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.394572 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.394710 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.394871 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.395002 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.395187 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.395313 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.395503 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.395625 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.395808 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.395958 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.396203 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.396329 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.396452 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.396571 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.396740 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.396865 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.397063 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.397187 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.397442 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.397580 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.397764 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.397897 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.398068 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.398205 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.398367 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.398498 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.398673 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.398798 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.398974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.399105 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.399273 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.399407 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.399589 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.399714 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.399887 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.400012 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.400192 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.400327 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.400497 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.400623 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.400799 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.400923 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.401099 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.401259 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.401425 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.401569 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.401733 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.401856 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.402030 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.402166 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.402336 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.402459 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.402645 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.402768 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.402950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.403074 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.403269 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.403392 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.403570 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.403808 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.403946 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.404069 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.404203 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.404324 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.404466 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.404591 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.404766 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.404892 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.405066 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.405226 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.405407 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.405529 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.405701 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.405828 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.406007 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.406132 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.406329 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.406460 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.406644 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.406790 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.406976 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.407100 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.407306 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.407438 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.407628 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.407751 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.407939 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.408063 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.408252 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.408384 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.408572 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.408697 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.408875 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.409000 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.409175 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.409337 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.409506 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.409631 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.409807 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.409939 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.410110 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.410236 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.410410 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.410536 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.410713 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.410838 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.411013 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.411140 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.411314 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.411448 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.411614 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.411739 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.411914 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.412039 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.412215 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.412338 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.412518 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.412652 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.412824 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.412948 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.413127 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.413297 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.413452 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.413597 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.413751 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.413952 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.414076 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.414196 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.414354 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.414488 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.414660 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.414785 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.414990 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.415113 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.415302 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.415440 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.415623 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.415745 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.415930 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.416054 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.416250 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.416458 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.416583 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.416703 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.416865 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.416997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.417175 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.417320 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.417510 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.417627 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.417820 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.417946 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.418130 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.418263 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.418441 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.418566 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.418746 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.418872 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.419057 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.419190 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.419367 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.419493 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.419675 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.419798 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.419994 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.420199 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.420332 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.420526 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.420651 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.420837 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.421133 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.421311 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.421463 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.421587 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.421774 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.421912 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.422083 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.422208 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.422906 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.423041 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.423223 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.423421 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.423544 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.423667 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.423822 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.423963 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.424157 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.424290 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.424412 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.424533 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.424725 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.424858 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.425052 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.425178 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.425398 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.425523 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.425709 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.425835 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.426019 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.426152 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.426329 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.426468 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.426652 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.426784 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.426947 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.427074 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.427262 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.427387 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.427569 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.427705 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.427880 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.428005 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.428187 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.428313 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.428494 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.428621 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.428803 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.428930 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.429113 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.429289 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.429428 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.429558 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.429739 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.429872 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.430044 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.430168 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.430352 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.430485 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.430665 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.430813 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.430970 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.431113 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.431286 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.431411 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.431597 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.431720 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.431906 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.432048 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.432214 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.432339 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.432524 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.432649 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.432850 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.433035 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.433163 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.433371 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.433497 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.433700 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.434012 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.434160 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.434347 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.434472 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.434628 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.434752 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.434943 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.435077 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.435265 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.435390 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.435568 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.435693 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.435870 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.436003 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.436175 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.436301 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.436479 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.436603 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.436808 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.436932 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.437079 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.437203 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.437407 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.437546 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.437709 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.437827 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.438566 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.438879 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.439384 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.439524 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.439821 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.439974 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.440139 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.440292 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.440466 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.440684 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.440840 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.440963 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.441083 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.441410 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.441540 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.441734 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.441861 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.442038 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.442163 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.442343 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.442477 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.442659 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.442784 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.442969 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.443095 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.443270 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.443405 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.443569 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.443702 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.443878 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.444003 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.444183 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.444334 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.444529 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.444656 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.444790 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.444923 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.445045 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.445174 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.445391 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.445519 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.445692 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.445817 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.445994 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.446121 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.446295 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.446420 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.446601 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.446726 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.446937 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.447068 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.447198 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.447319 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.447485 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.447610 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.447783 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.447910 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.448090 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.448214 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.448389 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.448514 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.448692 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.448863 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.448988 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.449109 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.449311 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.449445 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.449615 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.449740 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.449919 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.450037 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.450222 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.450347 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.450533 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.450658 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.450848 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.450976 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.451146 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.451278 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.451455 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.451578 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.451760 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.451883 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.452080 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.452213 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.452389 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.452514 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.452697 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.452830 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.453024 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.453157 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.453320 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.453456 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.453652 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.453921 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.454056 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.454253 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.454386 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.454588 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.454721 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.454892 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.455031 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.455214 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.455339 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.455515 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.455748 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.455877 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.456090 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.456217 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.456410 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.456533 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.456715 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.456848 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.457052 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.457185 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.457338 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.457462 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.457638 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.457775 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.457943 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.458062 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.458247 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.458373 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.458551 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.458685 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.458845 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.458971 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.459147 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.459273 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.459450 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.459576 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.459755 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.459888 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.460061 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.460185 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.460365 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.460492 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.460673 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.460797 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.460990 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.461114 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.461324 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.461466 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.461638 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.461763 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.461947 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.462070 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.462255 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.462380 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.462560 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.462682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.462866 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.462999 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.463171 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.463296 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.463476 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.463602 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.463811 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.463944 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.464132 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.464257 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.464446 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.464573 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.464769 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.464903 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.465053 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.465230 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.465377 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.465563 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.465701 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.465879 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.466012 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.466196 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.466321 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.466502 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.466636 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.466818 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.467004 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.467215 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.467347 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.467469 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.467627 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.467761 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.467950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.468075 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.468265 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.468397 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.468588 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.468714 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.468911 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.469043 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.469275 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.469423 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.469599 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.469723 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.469902 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.470027 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.470203 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.470337 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.470508 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.470639 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.470822 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.470948 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.471130 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.471256 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.471429 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.471554 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.471727 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.471860 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.472033 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.472166 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.472333 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.472457 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.472634 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.472760 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.472934 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.473347 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.473512 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.473638 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.473814 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.473939 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.474112 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.474238 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.474412 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.474538 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.474711 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.474924 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.475059 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.475188 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.475311 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.475431 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.475576 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.475710 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.475877 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.476011 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.476175 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.476300 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.476474 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.476611 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.476772 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.476898 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.477075 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.477222 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.477396 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.477527 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.477703 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.477827 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.478010 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.478135 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.478317 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.478444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.478622 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.478746 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.478925 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.479048 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.479226 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.479351 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.479533 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.479656 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.479849 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.479973 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.480164 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.480291 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.480474 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.480599 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.480783 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.480907 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.481104 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.481228 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.481431 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.481565 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.481740 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.482241 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.482364 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.482478 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.482583 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.482693 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.482805 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.482936 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.483059 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.483179 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.483342 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.483474 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.483605 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.483736 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.483858 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.483985 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.484113 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.484234 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.484426 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.484553 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.484742 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.485410 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.485594 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.485688 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.485904 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.485997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.486217 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.486304 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.486524 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.486621 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.486830 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.486919 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.487147 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.487240 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.487457 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.487565 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.487762 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.487850 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.488073 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.488159 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.488386 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.488498 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.488693 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.488783 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.489010 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.489095 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.489342 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.489448 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.489657 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.489751 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.489976 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.490062 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.490297 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.490392 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.490609 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.490709 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.490950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.491046 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.491260 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.491348 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.491568 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.491653 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.491877 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.491971 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.492181 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.492270 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.492425 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:47:16.492534 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.492881 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.493211 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.493552 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.493870 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.494182 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:47:16.494429 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:47:16.555060 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO dbcounter [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] Registered counter for database nova_api Jun 16 18:47:16.557069 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO dbcounter [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] Registered counter for database nova_api Jun 16 18:47:16.576094 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_db.sqlalchemy.engines [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:47:16.577706 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG oslo_db.sqlalchemy.engines [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:47:16.582917 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG dbcounter [-] [115451] Writer thread running {{(pid=115451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:47:16.584351 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writer thread running {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:47:16.640386 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.context [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),09ff3e34-0387-4a9f-a89a-c712eae3ab25(cell1) {{(pid=115451) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:47:16.641293 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.context [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),09ff3e34-0387-4a9f-a89a-c712eae3ab25(cell1) {{(pid=115452) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:47:16.644552 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:16.645403 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG oslo_concurrency.lockutils [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:16.646160 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:16.646959 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:16.647068 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG oslo_concurrency.lockutils [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:16.647784 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG oslo_concurrency.lockutils [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:47:16.648910 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:16.649766 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG oslo_concurrency.lockutils [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:47:16.650918 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO dbcounter [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] Registered counter for database nova_cell0 Jun 16 18:47:16.651751 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO dbcounter [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] Registered counter for database nova_cell0 Jun 16 18:47:16.654728 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO dbcounter [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] Registered counter for database nova_cell1 Jun 16 18:47:16.655519 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO dbcounter [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] Registered counter for database nova_cell1 Jun 16 18:47:16.662464 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_db.sqlalchemy.engines [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:47:16.664116 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_db.sqlalchemy.engines [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:47:16.665738 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG oslo_db.sqlalchemy.engines [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:47:16.667000 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG oslo_db.sqlalchemy.engines [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:47:16.669319 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG dbcounter [-] [115451] Writer thread running {{(pid=115451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:47:16.673964 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writer thread running {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:47:16.675979 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writer thread running {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:47:16.807197 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG dbcounter [-] [115451] Writer thread running {{(pid=115451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:47:16.817098 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO dbcounter [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] Registered counter for database nova_cell0 Jun 16 18:47:16.819595 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO dbcounter [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] Registered counter for database nova_cell0 Jun 16 18:47:16.825783 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_db.sqlalchemy.engines [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:47:16.829382 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG oslo_db.sqlalchemy.engines [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:47:16.830148 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG dbcounter [-] [115451] Writer thread running {{(pid=115451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:47:16.833669 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writer thread running {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:47:17.234947 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: WARNING keystonemiddleware.auth_token [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:47:17.242062 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: WARNING keystonemiddleware.auth_token [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:47:17.260650 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: WARNING keystonemiddleware.auth_token [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:47:17.268254 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: WARNING keystonemiddleware.auth_token [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:47:17.581488 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: WARNING keystonemiddleware.auth_token [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:47:17.587425 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: WARNING keystonemiddleware.auth_token [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:47:17.592612 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56105af579c0 pid: 115451 (default app) Jun 16 18:47:17.594728 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:47:17.595920 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] 10.222.0.81 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001769 Jun 16 18:47:17.596338 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 1/1] 10.222.0.81 () {50 vars in 788 bytes} [Thu Jun 16 18:47:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:47:17.606242 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: WARNING keystonemiddleware.auth_token [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:47:17.612140 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: WARNING keystonemiddleware.auth_token [None req-05d49e9a-981f-4358-9aed-6730c4c59ad1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:47:17.617329 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56105af579c0 pid: 115452 (default app) Jun 16 18:48:36.506940 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:36.507944 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 16 18:48:36.508327 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 2/2] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jun 16 18:48:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:48:36.520356 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writing DB stats nova_api:SELECT=3 {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:36.522377 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writing DB stats nova_cell1:SELECT=3 {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:36.523575 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writing DB stats nova_cell0:SELECT=3 {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:36.524309 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:36.974172 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-738c30f9-faaa-4c9b-9a4e-8db4cdb06957 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:37.003979 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-738c30f9-faaa-4c9b-9a4e-8db4cdb06957 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.489127 Jun 16 18:48:37.004680 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 1/3] 10.222.0.81 () {60 vars in 1291 bytes} [Thu Jun 16 18:48:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:39.180934 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:39.181891 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-444e6f57-b1a2-42eb-b649-983384df0f74 None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 16 18:48:39.182301 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 3/4] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jun 16 18:48:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:39.248046 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-72fb3462-5cdb-4ca2-b837-29f9aa63ece9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "disk": 1, "id": "c1"}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:39.267501 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:48:39.267501 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: warnings.warn(msg) Jun 16 18:48:39.368027 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-72fb3462-5cdb-4ca2-b837-29f9aa63ece9 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.178871 Jun 16 18:48:39.368666 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 2/5] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jun 16 18:48:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:48:39.382584 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG dbcounter [-] [115451] Writing DB stats nova_api:SELECT=3 {{(pid=115451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:39.383542 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG dbcounter [-] [115451] Writing DB stats nova_cell0:SELECT=3 {{(pid=115451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:39.384914 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG dbcounter [-] [115451] Writing DB stats nova_cell1:SELECT=3 {{(pid=115451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:39.385853 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG dbcounter [-] [115451] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:48:39.592864 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-f75b96a8-0d92-443f-a106-a76deb34e84b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:39.595437 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:48:39.595437 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: warnings.warn(msg) Jun 16 18:48:39.715956 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-f75b96a8-0d92-443f-a106-a76deb34e84b admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.338686 Jun 16 18:48:39.716747 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 4/6] 10.222.0.81 () {64 vars in 1335 bytes} [Thu Jun 16 18:48:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:48:42.030094 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-72fb3462-5cdb-4ca2-b837-29f9aa63ece9 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:42.031117 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-72fb3462-5cdb-4ca2-b837-29f9aa63ece9 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002148 Jun 16 18:48:42.031611 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 3/7] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jun 16 18:48:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:42.136656 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-1f823c1c-2c9a-4ae5-bdb9-940e64ddbdc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "vcpus": 1, "name": "ds512M"}} {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:42.155152 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:48:42.155152 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: warnings.warn(msg) Jun 16 18:48:42.238234 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-1f823c1c-2c9a-4ae5-bdb9-940e64ddbdc2 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.200617 Jun 16 18:48:42.238792 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 5/8] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jun 16 18:48:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:42.251318 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-d4f0fa77-d153-45c6-9656-513acf628357 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:42.252797 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:48:42.252797 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: warnings.warn(msg) Jun 16 18:48:42.355460 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-d4f0fa77-d153-45c6-9656-513acf628357 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108526 Jun 16 18:48:42.356052 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 4/9] 10.222.0.81 () {64 vars in 1335 bytes} [Thu Jun 16 18:48:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:44.535247 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-1f823c1c-2c9a-4ae5-bdb9-940e64ddbdc2 admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:44.536271 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-1f823c1c-2c9a-4ae5-bdb9-940e64ddbdc2 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 16 18:48:44.536828 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 6/10] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jun 16 18:48:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:44.600655 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-49d86a17-c3a7-4125-a611-155dd4666eb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:44.694583 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-49d86a17-c3a7-4125-a611-155dd4666eb9 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152136 Jun 16 18:48:44.695449 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 5/11] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jun 16 18:48:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:44.708204 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-dfbfe22c-18bf-4b2c-b087-2c8612c40643 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:44.784719 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-dfbfe22c-18bf-4b2c-b087-2c8612c40643 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080532 Jun 16 18:48:44.792087 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 7/12] 10.222.0.81 () {64 vars in 1335 bytes} [Thu Jun 16 18:48:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:48:46.984154 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-49d86a17-c3a7-4125-a611-155dd4666eb9 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:47.018053 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-49d86a17-c3a7-4125-a611-155dd4666eb9 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Jun 16 18:48:47.018053 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 6/13] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jun 16 18:48:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:47.047613 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-a00c79f4-5019-4d66-b7a0-0e96f8d905e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 2}} {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:47.263463 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-a00c79f4-5019-4d66-b7a0-0e96f8d905e2 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.271355 Jun 16 18:48:47.264144 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 8/14] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jun 16 18:48:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:47.276339 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-47a47f80-85f5-4d34-bd6c-4702945a42cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:47.377835 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-47a47f80-85f5-4d34-bd6c-4702945a42cf admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105306 Jun 16 18:48:47.378837 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 7/15] 10.222.0.81 () {64 vars in 1335 bytes} [Thu Jun 16 18:48:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:49.549314 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-a00c79f4-5019-4d66-b7a0-0e96f8d905e2 admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:49.550326 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-a00c79f4-5019-4d66-b7a0-0e96f8d905e2 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 16 18:48:49.550722 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 9/16] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jun 16 18:48:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:49.612991 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-23c32bee-40fc-4679-a1c9-5a78335ad0df admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "name": "ds4G", "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:49.698820 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-23c32bee-40fc-4679-a1c9-5a78335ad0df admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142158 Jun 16 18:48:49.699332 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 8/17] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jun 16 18:48:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:49.715887 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-63bde53c-aa54-4a9d-b592-5d4d3899fd66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:49.791155 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-63bde53c-aa54-4a9d-b592-5d4d3899fd66 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079822 Jun 16 18:48:49.791836 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 10/18] 10.222.0.81 () {64 vars in 1335 bytes} [Thu Jun 16 18:48:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:51.966165 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-23c32bee-40fc-4679-a1c9-5a78335ad0df admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:51.966675 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-23c32bee-40fc-4679-a1c9-5a78335ad0df admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002004 Jun 16 18:48:51.967050 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 9/19] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jun 16 18:48:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:52.031039 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-8424e7e9-e3c6-49f6-a158-96e763662807 admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:52.062594 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-8424e7e9-e3c6-49f6-a158-96e763662807 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.089553 Jun 16 18:48:52.063245 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 11/20] 10.222.0.81 () {60 vars in 1291 bytes} [Thu Jun 16 18:48:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:48:54.296956 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-23c32bee-40fc-4679-a1c9-5a78335ad0df admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:54.298003 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-23c32bee-40fc-4679-a1c9-5a78335ad0df admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 16 18:48:54.298414 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 10/21] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jun 16 18:48:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:48:54.363986 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-55d3a7df-0e78-431b-8215-0c3da12771b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "vcpus": 1, "swap": 0, "ram": 512}} {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:54.463767 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-55d3a7df-0e78-431b-8215-0c3da12771b6 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.158192 Jun 16 18:48:54.464667 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 12/22] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jun 16 18:48:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:54.479734 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-449a34eb-82bc-4497-aa78-2e4fc0fd3bd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:54.588841 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-449a34eb-82bc-4497-aa78-2e4fc0fd3bd7 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114186 Jun 16 18:48:54.589881 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 11/23] 10.222.0.81 () {64 vars in 1332 bytes} [Thu Jun 16 18:48:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:56.946318 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-55d3a7df-0e78-431b-8215-0c3da12771b6 admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:56.947340 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-55d3a7df-0e78-431b-8215-0c3da12771b6 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 16 18:48:56.948276 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 13/24] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jun 16 18:48:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:48:57.016207 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-89cb458e-90c5-46cc-88b8-f44fe5e9fdc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:57.149101 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-89cb458e-90c5-46cc-88b8-f44fe5e9fdc2 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.194572 Jun 16 18:48:57.150106 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 12/25] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jun 16 18:48:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:57.163754 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-7abc290c-e37f-4498-9fca-6d09b6edbbec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:57.283729 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-7abc290c-e37f-4498-9fca-6d09b6edbbec admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124294 Jun 16 18:48:57.284318 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 14/26] 10.222.0.81 () {64 vars in 1332 bytes} [Thu Jun 16 18:48:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:48:59.480963 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-89cb458e-90c5-46cc-88b8-f44fe5e9fdc2 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:48:59.482038 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-89cb458e-90c5-46cc-88b8-f44fe5e9fdc2 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jun 16 18:48:59.482597 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 13/27] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jun 16 18:48:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:48:59.543717 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-6150dabc-7a5d-405c-8c56-fd5c89060438 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "ram": 4096}} {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:59.623181 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-6150dabc-7a5d-405c-8c56-fd5c89060438 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.134525 Jun 16 18:48:59.623672 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 15/28] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jun 16 18:48:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:48:59.636261 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-7c273bd0-1f63-4427-b1fd-d5c5e4ce5591 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:48:59.732179 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-7c273bd0-1f63-4427-b1fd-d5c5e4ce5591 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100324 Jun 16 18:48:59.735814 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 14/29] 10.222.0.81 () {64 vars in 1332 bytes} [Thu Jun 16 18:48:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:01.889310 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-6150dabc-7a5d-405c-8c56-fd5c89060438 admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:01.890325 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-6150dabc-7a5d-405c-8c56-fd5c89060438 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 16 18:49:01.890729 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 16/30] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jun 16 18:49:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:01.948227 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-de626a9b-6cb0-40bf-b5c2-fee74a734699 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:02.044159 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-de626a9b-6cb0-40bf-b5c2-fee74a734699 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.147597 Jun 16 18:49:02.044722 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 15/31] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jun 16 18:49:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:49:02.056507 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-8509ec72-4ded-4ad8-8c15-494986d94b20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:02.180896 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-8509ec72-4ded-4ad8-8c15-494986d94b20 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.127961 Jun 16 18:49:02.181750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 17/32] 10.222.0.81 () {64 vars in 1332 bytes} [Thu Jun 16 18:49:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:04.363202 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-de626a9b-6cb0-40bf-b5c2-fee74a734699 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:04.364923 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-de626a9b-6cb0-40bf-b5c2-fee74a734699 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002155 Jun 16 18:49:04.366075 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 16/33] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jun 16 18:49:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:04.429384 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-8fc4ff4f-c68e-49da-9734-76975dec0424 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "ram": 16384, "swap": 0}} {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:04.510679 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-8fc4ff4f-c68e-49da-9734-76975dec0424 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.138178 Jun 16 18:49:04.513735 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 18/34] 10.222.0.81 () {64 vars in 1282 bytes} [Thu Jun 16 18:49:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:49:04.538979 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-f4206c95-5e0a-4bd0-a6d4-61c10103f654 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:04.623210 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-f4206c95-5e0a-4bd0-a6d4-61c10103f654 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100922 Jun 16 18:49:04.624491 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 17/35] 10.222.0.81 () {64 vars in 1332 bytes} [Thu Jun 16 18:49:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:49:29.240300 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-8fc4ff4f-c68e-49da-9734-76975dec0424 admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:29.241324 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-8fc4ff4f-c68e-49da-9734-76975dec0424 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 16 18:49:29.241720 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 19/36] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jun 16 18:49:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:29.252241 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:29.299984 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-a55cd05e-09e0-42f6-91ee-efcbd8df7228 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:29.316628 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-a55cd05e-09e0-42f6-91ee-efcbd8df7228 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069007 Jun 16 18:49:29.317162 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 18/37] 10.222.0.81 () {60 vars in 1291 bytes} [Thu Jun 16 18:49:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:49:30.291946 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-8fc4ff4f-c68e-49da-9734-76975dec0424 admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:30.292944 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-8fc4ff4f-c68e-49da-9734-76975dec0424 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 16 18:49:30.293360 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 20/38] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jun 16 18:49:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:30.501137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-5c99168f-c2d4-4e1a-bbfa-67c2db26de36 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:30.507878 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.wsgi [None req-5c99168f-c2d4-4e1a-bbfa-67c2db26de36 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-5c99168f-c2d4-4e1a-bbfa-67c2db26de36 admin admin] Request method failure captured: Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Accept: application/json Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Accept-Encoding: gzip, deflate Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Connection: keep-alive Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Content-Length: 0 Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Host: 10.222.0.81 Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Openstack-Api-Version: compute 2.90 Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Openstack-System-Scope: None Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: User-Agent: python-novaclient Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Auth-Token: gAAAAABiq3s6AZyCoFsMUw8-vtLRRlmVyVnGURB2T40lvcj11NqGarpbhcO5AyA5y10-YDv0bb8_0l3ad0Qh5RnjYVtVZX1k_e2uHot65g0SxNDs7s30phgV1B6J8rupyLfQSRLV3qiXEPOu8Ujwh_1bZZ6iTlYZV9ouyjKEHMyUUfIEa14iGS8 Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Domain-Id: None Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Domain-Name: None Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Identity-Status: Confirmed Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Is-Admin-Project: True Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Project-Domain-Id: default Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Project-Domain-Name: Default Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Project-Id: 3b167122bd2b4c3cba143eecf3576355 Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Project-Name: admin Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Role: member,admin,reader Jun 16 18:49:30.511197 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Roles: member,admin,reader Jun 16 18:49:30.512932 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3b167122bd2b4c3cba143eecf3576355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3b167122bd2b4c3cba143eecf3576355", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3b167122bd2b4c3cba143eecf3576355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3b167122bd2b4c3cba143eecf3576355"}]}] Jun 16 18:49:30.512932 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Tenant: admin Jun 16 18:49:30.512932 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Tenant-Id: 3b167122bd2b4c3cba143eecf3576355 Jun 16 18:49:30.512932 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Tenant-Name: admin Jun 16 18:49:30.512932 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-User: admin Jun 16 18:49:30.512932 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-User-Domain-Id: default Jun 16 18:49:30.512932 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-User-Domain-Name: Default Jun 16 18:49:30.512932 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-User-Id: 88fee257b59d48f2b418ffa9e86b6f8e Jun 16 18:49:30.512932 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-User-Name: admin Jun 16 18:49:30.512932 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: method: > Jun 16 18:49:30.512932 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: exception: Flavor 42 could not be found. Jun 16 18:49:30.512932 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: action_args: {'id': '42'} Jun 16 18:49:30.512932 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:49:30.512932 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:30.518950 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Jun 16 18:49:30.520824 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-5c99168f-c2d4-4e1a-bbfa-67c2db26de36 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:49:30.522139 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-5c99168f-c2d4-4e1a-bbfa-67c2db26de36 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062321 Jun 16 18:49:30.522139 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 19/39] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jun 16 18:49:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:30.522835 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-a83d450d-381d-4b85-bc8a-8f63079a60db admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:30.532898 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG dbcounter [-] [115451] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:49:30.543534 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-a83d450d-381d-4b85-bc8a-8f63079a60db admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024755 Jun 16 18:49:30.544090 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 21/40] 10.222.0.81 () {60 vars in 1210 bytes} [Thu Jun 16 18:49:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:49:30.553621 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-e0a97ab0-f4d1-427d-8f2f-9e0087cc658d admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:30.575508 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-e0a97ab0-f4d1-427d-8f2f-9e0087cc658d admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025469 Jun 16 18:49:30.576038 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 20/41] 10.222.0.81 () {60 vars in 1210 bytes} [Thu Jun 16 18:49:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:49:30.585927 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-68c59710-0637-47e0-b9e5-50c70128306b admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:30.591942 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.wsgi [None req-68c59710-0637-47e0-b9e5-50c70128306b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-68c59710-0637-47e0-b9e5-50c70128306b admin admin] Request method failure captured: Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Accept: application/json Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Accept-Encoding: gzip, deflate Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Connection: keep-alive Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Content-Length: 0 Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Host: 10.222.0.81 Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Openstack-Api-Version: compute 2.90 Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Openstack-System-Scope: None Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: User-Agent: python-novaclient Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Auth-Token: gAAAAABiq3s6AZyCoFsMUw8-vtLRRlmVyVnGURB2T40lvcj11NqGarpbhcO5AyA5y10-YDv0bb8_0l3ad0Qh5RnjYVtVZX1k_e2uHot65g0SxNDs7s30phgV1B6J8rupyLfQSRLV3qiXEPOu8Ujwh_1bZZ6iTlYZV9ouyjKEHMyUUfIEa14iGS8 Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Domain-Id: None Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Domain-Name: None Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Identity-Status: Confirmed Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Is-Admin-Project: True Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Project-Domain-Id: default Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Project-Domain-Name: Default Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Project-Id: 3b167122bd2b4c3cba143eecf3576355 Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Project-Name: admin Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Role: member,admin,reader Jun 16 18:49:30.595212 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Roles: member,admin,reader Jun 16 18:49:30.596777 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3b167122bd2b4c3cba143eecf3576355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3b167122bd2b4c3cba143eecf3576355", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3b167122bd2b4c3cba143eecf3576355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3b167122bd2b4c3cba143eecf3576355"}]}] Jun 16 18:49:30.596777 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Tenant: admin Jun 16 18:49:30.596777 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Tenant-Id: 3b167122bd2b4c3cba143eecf3576355 Jun 16 18:49:30.596777 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Tenant-Name: admin Jun 16 18:49:30.596777 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-User: admin Jun 16 18:49:30.596777 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-User-Domain-Id: default Jun 16 18:49:30.596777 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-User-Domain-Name: Default Jun 16 18:49:30.596777 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-User-Id: 88fee257b59d48f2b418ffa9e86b6f8e Jun 16 18:49:30.596777 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-User-Name: admin Jun 16 18:49:30.596777 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: method: > Jun 16 18:49:30.596777 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: exception: Flavor 42 could not be found. Jun 16 18:49:30.596777 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: action_args: {'id': '42'} Jun 16 18:49:30.596777 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:49:30.596777 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:30.602855 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Jun 16 18:49:30.603974 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-68c59710-0637-47e0-b9e5-50c70128306b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:49:30.605004 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-68c59710-0637-47e0-b9e5-50c70128306b admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014973 Jun 16 18:49:30.605004 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 22/42] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jun 16 18:49:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:31.461963 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-e0a97ab0-f4d1-427d-8f2f-9e0087cc658d admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:31.462973 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-e0a97ab0-f4d1-427d-8f2f-9e0087cc658d admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 16 18:49:31.463370 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 21/43] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jun 16 18:49:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:31.652004 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-295fd242-058c-41a1-9569-75a45df477f3 admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:31.657832 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.wsgi [None req-295fd242-058c-41a1-9569-75a45df477f3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-295fd242-058c-41a1-9569-75a45df477f3 admin admin] Request method failure captured: Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Accept: application/json Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Accept-Encoding: gzip, deflate Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Connection: keep-alive Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Content-Length: 0 Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Host: 10.222.0.81 Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Openstack-Api-Version: compute 2.90 Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Openstack-System-Scope: None Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: User-Agent: python-novaclient Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Auth-Token: gAAAAABiq3s7430p-V4LJQhnGiRTU86UjIFBZdycgXo5Rw7AbJdsyRWC6a0mUW70h1DS9xMT00jnpSJClaHo6UgtBHc_TCbHkrqrHxou9n-I7koXHbtuYGa-YRdqlFbxh02V4-JVf0z96oJZRTIkwmKCrcGjuDf0ap12Z4MvdtiY7TBfiTenzIE Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Domain-Id: None Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Domain-Name: None Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Identity-Status: Confirmed Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Is-Admin-Project: True Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Project-Domain-Id: default Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Project-Domain-Name: Default Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Project-Id: 3b167122bd2b4c3cba143eecf3576355 Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Project-Name: admin Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Role: member,admin,reader Jun 16 18:49:31.659913 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Roles: member,admin,reader Jun 16 18:49:31.661553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3b167122bd2b4c3cba143eecf3576355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3b167122bd2b4c3cba143eecf3576355", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3b167122bd2b4c3cba143eecf3576355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3b167122bd2b4c3cba143eecf3576355"}]}] Jun 16 18:49:31.661553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Tenant: admin Jun 16 18:49:31.661553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Tenant-Id: 3b167122bd2b4c3cba143eecf3576355 Jun 16 18:49:31.661553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Tenant-Name: admin Jun 16 18:49:31.661553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-User: admin Jun 16 18:49:31.661553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-User-Domain-Id: default Jun 16 18:49:31.661553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-User-Domain-Name: Default Jun 16 18:49:31.661553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-User-Id: 88fee257b59d48f2b418ffa9e86b6f8e Jun 16 18:49:31.661553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-User-Name: admin Jun 16 18:49:31.661553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: method: > Jun 16 18:49:31.661553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: exception: Flavor 84 could not be found. Jun 16 18:49:31.661553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: action_args: {'id': '84'} Jun 16 18:49:31.661553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:49:31.661553 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:31.666768 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Jun 16 18:49:31.667996 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-295fd242-058c-41a1-9569-75a45df477f3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:49:31.669078 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-295fd242-058c-41a1-9569-75a45df477f3 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061089 Jun 16 18:49:31.669078 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 23/44] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jun 16 18:49:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:31.670910 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-007aa049-d8a9-4635-ad39-b43fc63b1279 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:31.686175 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-007aa049-d8a9-4635-ad39-b43fc63b1279 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018872 Jun 16 18:49:31.686701 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 22/45] 10.222.0.81 () {60 vars in 1210 bytes} [Thu Jun 16 18:49:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:49:31.696171 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-b53921c7-5b1f-4959-9de0-b5003cb0e9e7 admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:31.710531 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-b53921c7-5b1f-4959-9de0-b5003cb0e9e7 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018088 Jun 16 18:49:31.711053 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 24/46] 10.222.0.81 () {60 vars in 1210 bytes} [Thu Jun 16 18:49:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:49:31.719935 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-404ac8b9-2667-4a58-946f-109e6e6a6f50 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:31.725923 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.wsgi [None req-404ac8b9-2667-4a58-946f-109e6e6a6f50 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-404ac8b9-2667-4a58-946f-109e6e6a6f50 admin admin] Request method failure captured: Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Accept: application/json Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Accept-Encoding: gzip, deflate Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Connection: keep-alive Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Content-Length: 0 Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Host: 10.222.0.81 Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Openstack-Api-Version: compute 2.90 Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Openstack-System-Scope: None Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: User-Agent: python-novaclient Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Auth-Token: gAAAAABiq3s7430p-V4LJQhnGiRTU86UjIFBZdycgXo5Rw7AbJdsyRWC6a0mUW70h1DS9xMT00jnpSJClaHo6UgtBHc_TCbHkrqrHxou9n-I7koXHbtuYGa-YRdqlFbxh02V4-JVf0z96oJZRTIkwmKCrcGjuDf0ap12Z4MvdtiY7TBfiTenzIE Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Domain-Id: None Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Domain-Name: None Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Identity-Status: Confirmed Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Is-Admin-Project: True Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Project-Domain-Id: default Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Project-Domain-Name: Default Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Project-Id: 3b167122bd2b4c3cba143eecf3576355 Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Project-Name: admin Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Role: member,admin,reader Jun 16 18:49:31.727427 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Roles: member,admin,reader Jun 16 18:49:31.729051 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3b167122bd2b4c3cba143eecf3576355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3b167122bd2b4c3cba143eecf3576355", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3b167122bd2b4c3cba143eecf3576355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3b167122bd2b4c3cba143eecf3576355"}]}] Jun 16 18:49:31.729051 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Tenant: admin Jun 16 18:49:31.729051 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Tenant-Id: 3b167122bd2b4c3cba143eecf3576355 Jun 16 18:49:31.729051 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Tenant-Name: admin Jun 16 18:49:31.729051 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-User: admin Jun 16 18:49:31.729051 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-User-Domain-Id: default Jun 16 18:49:31.729051 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-User-Domain-Name: Default Jun 16 18:49:31.729051 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-User-Id: 88fee257b59d48f2b418ffa9e86b6f8e Jun 16 18:49:31.729051 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-User-Name: admin Jun 16 18:49:31.729051 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: method: > Jun 16 18:49:31.729051 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: exception: Flavor 84 could not be found. Jun 16 18:49:31.729051 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: action_args: {'id': '84'} Jun 16 18:49:31.729051 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:49:31.729051 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:31.731137 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Jun 16 18:49:31.732544 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-404ac8b9-2667-4a58-946f-109e6e6a6f50 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:49:31.733598 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-404ac8b9-2667-4a58-946f-109e6e6a6f50 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012338 Jun 16 18:49:31.733598 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 23/47] 10.222.0.81 () {60 vars in 1190 bytes} [Thu Jun 16 18:49:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 18:49:32.594910 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-b53921c7-5b1f-4959-9de0-b5003cb0e9e7 admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:32.595915 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-b53921c7-5b1f-4959-9de0-b5003cb0e9e7 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 16 18:49:32.596341 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 25/48] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jun 16 18:49:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:32.784293 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-c6052329-8a80-4cde-93ed-7070b58db066 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:32.789671 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.wsgi [None req-c6052329-8a80-4cde-93ed-7070b58db066 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-c6052329-8a80-4cde-93ed-7070b58db066 admin admin] Request method failure captured: Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Accept: application/json Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Accept-Encoding: gzip, deflate Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Connection: keep-alive Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Content-Length: 0 Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Host: 10.222.0.81 Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Openstack-Api-Version: compute 2.90 Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Openstack-System-Scope: None Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: User-Agent: python-novaclient Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Auth-Token: gAAAAABiq3s8R7Pw-cxU3s88Llldh4Cp1cto1m7x34IopThOyqq2sm0s-jljZrtQvP8d-tV4HBSCnGI5k5BcQLvtV3VF2Ip8GXVkpC6WwaxE7gR8E6o3G8NJP2Jj1Ffj--JFG_ebX8DcxnHrybAEbokKx-Ma6EhiuFkkhTWYxQPRbsnAwnpMU-k Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Domain-Id: None Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Domain-Name: None Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Identity-Status: Confirmed Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Is-Admin-Project: True Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Project-Domain-Id: default Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Project-Domain-Name: Default Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Project-Id: 3b167122bd2b4c3cba143eecf3576355 Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Project-Name: admin Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Role: member,admin,reader Jun 16 18:49:32.791171 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Roles: member,admin,reader Jun 16 18:49:32.792682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3b167122bd2b4c3cba143eecf3576355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3b167122bd2b4c3cba143eecf3576355", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3b167122bd2b4c3cba143eecf3576355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3b167122bd2b4c3cba143eecf3576355"}]}] Jun 16 18:49:32.792682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Tenant: admin Jun 16 18:49:32.792682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Tenant-Id: 3b167122bd2b4c3cba143eecf3576355 Jun 16 18:49:32.792682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-Tenant-Name: admin Jun 16 18:49:32.792682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-User: admin Jun 16 18:49:32.792682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-User-Domain-Id: default Jun 16 18:49:32.792682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-User-Domain-Name: Default Jun 16 18:49:32.792682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-User-Id: 88fee257b59d48f2b418ffa9e86b6f8e Jun 16 18:49:32.792682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: X-User-Name: admin Jun 16 18:49:32.792682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: method: > Jun 16 18:49:32.792682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: exception: Flavor 451 could not be found. Jun 16 18:49:32.792682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: action_args: {'id': '451'} Jun 16 18:49:32.792682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:49:32.792682 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:32.793712 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: ERROR nova.api.openstack.wsgi Jun 16 18:49:32.794997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-c6052329-8a80-4cde-93ed-7070b58db066 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115452) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:49:32.796237 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-c6052329-8a80-4cde-93ed-7070b58db066 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059440 Jun 16 18:49:32.796237 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 24/49] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jun 16 18:49:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:32.802027 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-11b46c70-e028-49b8-a483-0707cd50c8f1 admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:32.817307 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-11b46c70-e028-49b8-a483-0707cd50c8f1 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018837 Jun 16 18:49:32.817851 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 26/50] 10.222.0.81 () {60 vars in 1210 bytes} [Thu Jun 16 18:49:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:49:32.827521 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-2debc361-4ed7-467d-9824-3a3d99e8c382 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:32.840997 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-2debc361-4ed7-467d-9824-3a3d99e8c382 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017356 Jun 16 18:49:32.841555 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 25/51] 10.222.0.81 () {60 vars in 1210 bytes} [Thu Jun 16 18:49:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:49:32.850204 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-903a05b8-f1b0-40c3-9b3e-84a959495ab8 admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:32.855368 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.wsgi [None req-903a05b8-f1b0-40c3-9b3e-84a959495ab8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-903a05b8-f1b0-40c3-9b3e-84a959495ab8 admin admin] Request method failure captured: Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Accept: application/json Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Accept-Encoding: gzip, deflate Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Connection: keep-alive Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Content-Length: 0 Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Host: 10.222.0.81 Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Openstack-Api-Version: compute 2.90 Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Openstack-System-Scope: None Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: User-Agent: python-novaclient Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Auth-Token: gAAAAABiq3s8R7Pw-cxU3s88Llldh4Cp1cto1m7x34IopThOyqq2sm0s-jljZrtQvP8d-tV4HBSCnGI5k5BcQLvtV3VF2Ip8GXVkpC6WwaxE7gR8E6o3G8NJP2Jj1Ffj--JFG_ebX8DcxnHrybAEbokKx-Ma6EhiuFkkhTWYxQPRbsnAwnpMU-k Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Domain-Id: None Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Domain-Name: None Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Identity-Status: Confirmed Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Is-Admin-Project: True Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Project-Domain-Id: default Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Project-Domain-Name: Default Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Project-Id: 3b167122bd2b4c3cba143eecf3576355 Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Project-Name: admin Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Role: member,admin,reader Jun 16 18:49:32.856838 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Roles: member,admin,reader Jun 16 18:49:32.858444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3b167122bd2b4c3cba143eecf3576355"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_3b167122bd2b4c3cba143eecf3576355", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/3b167122bd2b4c3cba143eecf3576355"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/3b167122bd2b4c3cba143eecf3576355"}]}] Jun 16 18:49:32.858444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Tenant: admin Jun 16 18:49:32.858444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Tenant-Id: 3b167122bd2b4c3cba143eecf3576355 Jun 16 18:49:32.858444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-Tenant-Name: admin Jun 16 18:49:32.858444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-User: admin Jun 16 18:49:32.858444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-User-Domain-Id: default Jun 16 18:49:32.858444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-User-Domain-Name: Default Jun 16 18:49:32.858444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-User-Id: 88fee257b59d48f2b418ffa9e86b6f8e Jun 16 18:49:32.858444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: X-User-Name: admin Jun 16 18:49:32.858444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: method: > Jun 16 18:49:32.858444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: exception: Flavor 451 could not be found. Jun 16 18:49:32.858444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: action_args: {'id': '451'} Jun 16 18:49:32.858444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:49:32.858444 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:32.859346 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: ERROR nova.api.openstack.wsgi Jun 16 18:49:32.860750 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-903a05b8-f1b0-40c3-9b3e-84a959495ab8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115451) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:49:32.862091 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-903a05b8-f1b0-40c3-9b3e-84a959495ab8 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011420 Jun 16 18:49:32.862091 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 27/52] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jun 16 18:49:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:49:33.719483 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-2debc361-4ed7-467d-9824-3a3d99e8c382 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:33.720486 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-2debc361-4ed7-467d-9824-3a3d99e8c382 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 16 18:49:33.720904 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 26/53] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jun 16 18:49:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:33.909402 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-8eab45cf-a5cb-433f-9134-f177f347db00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:33.996945 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-8eab45cf-a5cb-433f-9134-f177f347db00 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.137738 Jun 16 18:49:33.997428 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 28/54] 10.222.0.81 () {64 vars in 1235 bytes} [Thu Jun 16 18:49:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:49:34.864406 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-2debc361-4ed7-467d-9824-3a3d99e8c382 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:34.865449 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-2debc361-4ed7-467d-9824-3a3d99e8c382 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 16 18:49:34.865847 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 27/55] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jun 16 18:49:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:35.056383 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-d47dc7cc-28b8-4bc3-986d-413e1631051f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:35.127968 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-d47dc7cc-28b8-4bc3-986d-413e1631051f admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.122653 Jun 16 18:49:35.135392 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 29/56] 10.222.0.81 () {64 vars in 1235 bytes} [Thu Jun 16 18:49:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:49:35.986819 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-2debc361-4ed7-467d-9824-3a3d99e8c382 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:35.987730 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-2debc361-4ed7-467d-9824-3a3d99e8c382 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001916 Jun 16 18:49:35.988130 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 28/57] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jun 16 18:49:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:36.177498 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-1c0428d8-a92a-4ac2-84de-0fd62625bf05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:36.265225 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-1c0428d8-a92a-4ac2-84de-0fd62625bf05 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.138852 Jun 16 18:49:36.265734 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 30/58] 10.222.0.81 () {64 vars in 1235 bytes} [Thu Jun 16 18:49:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:49:37.131886 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-2debc361-4ed7-467d-9824-3a3d99e8c382 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:37.132876 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-2debc361-4ed7-467d-9824-3a3d99e8c382 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Jun 16 18:49:37.133301 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 29/59] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jun 16 18:49:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:37.319926 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-d2e910e6-969a-430b-97fe-ff9332055d66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:49:37.419628 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-d2e910e6-969a-430b-97fe-ff9332055d66 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.149690 Jun 16 18:49:37.420170 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 31/60] 10.222.0.81 () {64 vars in 1235 bytes} [Thu Jun 16 18:49:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:49:38.282487 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-2debc361-4ed7-467d-9824-3a3d99e8c382 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:38.284227 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-2debc361-4ed7-467d-9824-3a3d99e8c382 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002168 Jun 16 18:49:38.284626 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 30/61] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jun 16 18:49:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:49:38.503370 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-398d6802-c0a5-4734-840a-ec2955251d7a admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:49:38.522865 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-398d6802-c0a5-4734-840a-ec2955251d7a admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.082462 Jun 16 18:49:38.523402 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 32/62] 10.222.0.81 () {60 vars in 1202 bytes} [Thu Jun 16 18:49:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:50:26.420213 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-2debc361-4ed7-467d-9824-3a3d99e8c382 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:26.421268 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-2debc361-4ed7-467d-9824-3a3d99e8c382 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 16 18:50:26.421687 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 31/63] 10.222.0.81 () {54 vars in 930 bytes} [Thu Jun 16 18:50:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:26.432003 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG dbcounter [-] [115451] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:26.480710 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-a393f63f-c7c4-4229-b23f-4e49f923d6d4 admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:26.500199 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-a393f63f-c7c4-4229-b23f-4e49f923d6d4 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072618 Jun 16 18:50:26.500730 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 33/64] 10.222.0.81 () {60 vars in 1291 bytes} [Thu Jun 16 18:50:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:50:26.524086 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-b8b3f440-1a6a-4994-b0af-f49195813b13 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:26.527504 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG dbcounter [-] [115452] Writing DB stats nova_api:SELECT=14 {{(pid=115452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:50:26.532577 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-b8b3f440-1a6a-4994-b0af-f49195813b13 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012596 Jun 16 18:50:26.533092 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 32/65] 10.222.0.81 () {60 vars in 1282 bytes} [Thu Jun 16 18:50:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:26.544517 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-bc9c5d1b-f4af-4901-850a-11ecfcd3f3fb admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:26.552041 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-bc9c5d1b-f4af-4901-850a-11ecfcd3f3fb admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011281 Jun 16 18:50:26.552574 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 34/66] 10.222.0.81 () {60 vars in 1285 bytes} [Thu Jun 16 18:50:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:26.564310 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-dab5bcf7-bdb8-4f69-82d8-ccd05f840de1 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:26.572592 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-dab5bcf7-bdb8-4f69-82d8-ccd05f840de1 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012016 Jun 16 18:50:26.573105 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 33/67] 10.222.0.81 () {60 vars in 1285 bytes} [Thu Jun 16 18:50:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:50:26.584822 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-9635280b-7c5d-4bfb-b945-047e89c68b15 admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:26.592344 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-9635280b-7c5d-4bfb-b945-047e89c68b15 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011648 Jun 16 18:50:26.592857 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 35/68] 10.222.0.81 () {60 vars in 1282 bytes} [Thu Jun 16 18:50:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:51.586046 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-dab5bcf7-bdb8-4f69-82d8-ccd05f840de1 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:51.587048 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-dab5bcf7-bdb8-4f69-82d8-ccd05f840de1 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 16 18:53:51.587444 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 34/69] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jun 16 18:53:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:51.741424 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG dbcounter [-] [115451] Writing DB stats nova_api:SELECT=6 {{(pid=115451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:51.854342 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-ce613d2a-23c0-4b44-aac0-90c96f7e8d1e admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:51.855514 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:53:51.855514 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: warnings.warn(msg) Jun 16 18:53:51.856730 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-ce613d2a-23c0-4b44-aac0-90c96f7e8d1e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:51.857158 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-ce613d2a-23c0-4b44-aac0-90c96f7e8d1e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:51.857970 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-ce613d2a-23c0-4b44-aac0-90c96f7e8d1e admin admin] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:51.858398 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-ce613d2a-23c0-4b44-aac0-90c96f7e8d1e admin admin] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:51.892072 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-ce613d2a-23c0-4b44-aac0-90c96f7e8d1e admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152156 Jun 16 18:53:51.892631 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 36/70] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jun 16 18:53:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:53:52.887809 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-dab5bcf7-bdb8-4f69-82d8-ccd05f840de1 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:52.888808 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-dab5bcf7-bdb8-4f69-82d8-ccd05f840de1 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 16 18:53:52.889203 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 35/71] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jun 16 18:53:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:53:53.094179 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-e6c53adb-aaa5-456a-bb4f-cf6cc14f14d6 admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:53.097398 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:53:53.097398 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: warnings.warn(msg) Jun 16 18:53:53.097398 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-e6c53adb-aaa5-456a-bb4f-cf6cc14f14d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:53.097398 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-e6c53adb-aaa5-456a-bb4f-cf6cc14f14d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:53.098285 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-e6c53adb-aaa5-456a-bb4f-cf6cc14f14d6 admin admin] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:53:53.098744 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-e6c53adb-aaa5-456a-bb4f-cf6cc14f14d6 admin admin] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:53:53.119791 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-e6c53adb-aaa5-456a-bb4f-cf6cc14f14d6 admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083191 Jun 16 18:53:53.120360 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 37/72] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jun 16 18:53:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:54:04.384553 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-dab5bcf7-bdb8-4f69-82d8-ccd05f840de1 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:04.385633 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-dab5bcf7-bdb8-4f69-82d8-ccd05f840de1 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 16 18:54:04.386067 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 36/73] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jun 16 18:54:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:54:04.531263 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG dbcounter [-] [115451] Writing DB stats nova_cell0:SELECT=4 {{(pid=115451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:04.532007 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG dbcounter [-] [115451] Writing DB stats nova_cell1:SELECT=4 {{(pid=115451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:04.532633 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG dbcounter [-] [115451] Writing DB stats nova_api:SELECT=8 {{(pid=115451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:54:04.579629 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-1afac51b-81a0-4e0c-abf6-146424b71fee admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:04.580836 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:54:04.580836 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: warnings.warn(msg) Jun 16 18:54:04.582071 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-1afac51b-81a0-4e0c-abf6-146424b71fee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:04.582514 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-1afac51b-81a0-4e0c-abf6-146424b71fee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:04.583411 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-1afac51b-81a0-4e0c-abf6-146424b71fee admin admin] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:04.583847 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-1afac51b-81a0-4e0c-abf6-146424b71fee admin admin] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:04.609618 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-1afac51b-81a0-4e0c-abf6-146424b71fee admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083336 Jun 16 18:54:04.610099 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 38/74] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jun 16 18:54:04 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:54:05.474072 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: DEBUG nova.api.openstack.wsgi [None req-dab5bcf7-bdb8-4f69-82d8-ccd05f840de1 admin admin] Calling method '>' {{(pid=115452) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:05.475101 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: INFO nova.api.openstack.requestlog [None req-dab5bcf7-bdb8-4f69-82d8-ccd05f840de1 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 16 18:54:05.475492 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: [pid: 115452|app: 0|req: 37/75] 10.222.0.81 () {56 vars in 1074 bytes} [Thu Jun 16 18:54:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:54:05.665068 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG nova.api.openstack.wsgi [None req-12e75b76-8354-4706-9d79-07d339d5500d admin admin] Calling method '>' {{(pid=115451) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:54:05.666258 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:54:05.666258 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: warnings.warn(msg) Jun 16 18:54:05.667493 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-12e75b76-8354-4706-9d79-07d339d5500d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:05.667963 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-12e75b76-8354-4706-9d79-07d339d5500d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:05.668754 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-12e75b76-8354-4706-9d79-07d339d5500d admin admin] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:54:05.669222 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: DEBUG oslo_concurrency.lockutils [None req-12e75b76-8354-4706-9d79-07d339d5500d admin admin] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115451) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:54:05.691158 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: INFO nova.api.openstack.requestlog [None req-12e75b76-8354-4706-9d79-07d339d5500d admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076114 Jun 16 18:54:05.691697 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: [pid: 115451|app: 0|req: 39/76] 10.222.0.81 () {60 vars in 1193 bytes} [Thu Jun 16 18:54:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:55:02.408660 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: Thu Jun 16 18:55:02 2022 - graceful shutdown triggered... Jun 16 18:55:02.408405 dv-cinder-846171-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 18:55:02.409617 dv-cinder-846171-1-iscsi devstack@n-api.service[115451]: Gracefully killing worker 1 (pid: 115451)... Jun 16 18:55:02.410177 dv-cinder-846171-1-iscsi devstack@n-api.service[115452]: Gracefully killing worker 2 (pid: 115452)... Jun 16 18:55:03.409380 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: worker 1 buried after 1 seconds Jun 16 18:55:03.409858 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: worker 2 buried after 1 seconds Jun 16 18:55:03.409858 dv-cinder-846171-1-iscsi devstack@n-api.service[115450]: goodbye to uWSGI. Jun 16 18:55:03.410980 dv-cinder-846171-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 18:55:03.411527 dv-cinder-846171-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 18:55:03.414238 dv-cinder-846171-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 18:55:03.428360 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 18:55:03.430399 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 18:55:03 2022] *** Jun 16 18:55:03.430399 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 18:55:03.430399 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 18:55:03.430399 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: nodename: dv-cinder-846171-1-iscsi Jun 16 18:55:03.430399 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: machine: x86_64 Jun 16 18:55:03.430399 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: clock source: unix Jun 16 18:55:03.430399 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: pcre jit disabled Jun 16 18:55:03.430399 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: detected number of CPU cores: 4 Jun 16 18:55:03.430399 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: current working directory: / Jun 16 18:55:03.430399 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: detected binary path: /usr/bin/uwsgi-core Jun 16 18:55:03.431201 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: your processes number limit is 47680 Jun 16 18:55:03.431201 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: your memory page size is 4096 bytes Jun 16 18:55:03.431201 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: detected max file descriptor number: 2048 Jun 16 18:55:03.431201 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: lock engine: pthread robust mutexes Jun 16 18:55:03.431201 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: thunder lock: enabled Jun 16 18:55:03.431201 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 18:55:03.431201 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 18:55:03.479866 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: Python main interpreter initialized at 0x5571f3a959c0 Jun 16 18:55:03.479866 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: python threads support enabled Jun 16 18:55:03.479866 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: your server socket listen backlog is limited to 100 connections Jun 16 18:55:03.479866 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: your mercy for graceful operations on workers is 90 seconds Jun 16 18:55:03.480282 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 18:55:03.480282 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: *** Operational MODE: preforking *** Jun 16 18:55:03.480685 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: *** uWSGI is running in multiple interpreter mode *** Jun 16 18:55:03.480685 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: spawned uWSGI master process (pid: 130228) Jun 16 18:55:03.480800 dv-cinder-846171-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 18:55:03.481461 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: spawned uWSGI worker 1 (pid: 130229, cores: 1) Jun 16 18:55:03.481805 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: spawned uWSGI worker 2 (pid: 130230, cores: 1) Jun 16 18:55:03.482870 dv-cinder-846171-1-iscsi devstack@n-api.service[130228]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 18:55:04.143076 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:55:04.159844 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:55:05.392138 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:55:05.392138 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: from cryptography.utils import int_from_bytes Jun 16 18:55:05.392705 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:55:05.392705 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: from cryptography.utils import int_from_bytes Jun 16 18:55:05.407891 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:55:05.407891 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: from cryptography.utils import int_from_bytes Jun 16 18:55:05.408392 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:55:05.408392 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: from cryptography.utils import int_from_bytes Jun 16 18:55:07.813629 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:55:07.814181 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:55:07.814488 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:55:07.814780 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:55:07.815036 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:55:07.815422 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.815747 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.816069 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.816386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.817129 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.817129 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.817398 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.817810 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.817990 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.818245 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.818558 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.818887 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846171-1-iscsi {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.819209 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.819531 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.819840 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.820157 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.820463 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.820788 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.821093 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.821614 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.822056 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.822363 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.822672 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.823043 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.823360 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.823671 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.823993 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.824307 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.824633 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.824952 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.825363 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846171-1-iscsi {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.825685 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.826029 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.826339 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.826794 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.827104 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.827414 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.827736 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.828059 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.828364 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.828701 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.829019 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.829357 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.829679 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.829984 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.830294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.830604 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.830923 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.831228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.831536 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.831787 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.832094 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.832413 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.832730 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.833051 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.833323 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.833575 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.833892 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.833998 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:55:07.834378 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.834476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:55:07.834563 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.834748 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:55:07.834852 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.835104 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.835215 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:55:07.835360 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:55:07.835460 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.835698 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.835806 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.836009 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.836122 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.836314 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.836412 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.836616 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.836738 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.836934 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.837035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.837312 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.837412 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.837593 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.837708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.837899 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.838034 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.838219 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.838320 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.838528 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.838621 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.838847 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.838938 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.839154 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.839250 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846171-1-iscsi {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.839489 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.839581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.839803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.839894 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.840132 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.840276 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.840450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.840656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.840772 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.841104 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.841213 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.841329 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.841419 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.842140 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.842245 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.842545 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.842776 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.842886 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.843099 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.843180 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.843413 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.843492 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.843713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.843807 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.844017 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.844109 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.844334 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.844423 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.844645 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.844737 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.844951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.845038 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.845371 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.845467 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.851782 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.851923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.852008 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.852085 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.852159 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.852248 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846171-1-iscsi {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.852331 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.852404 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.852476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.852556 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.852894 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.852978 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.853058 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.853058 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.853202 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.853319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.853407 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.853495 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.853575 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.853654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.853727 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.853805 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.853890 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.853964 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.854049 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.854124 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.854201 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.854273 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.854360 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.854440 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.854518 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.854605 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.854687 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.854775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.854846 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.854916 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.854986 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.855569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.855723 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.855882 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.856034 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.856180 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.856355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.856534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.856704 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.856849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.856991 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.857133 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.857944 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.858126 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.858282 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.858434 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.858579 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.858729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.858935 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.859086 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.859249 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.859395 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.859538 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.859692 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.859843 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.859988 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.860137 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.860291 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.860454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.860614 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.860757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.860907 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.861355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.861519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.861674 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.861847 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.862222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.862381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.862527 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.862680 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.862824 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.862982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.863133 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.863277 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.863429 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.863594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.863747 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.863891 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.864033 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.864183 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.864334 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.864486 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.864638 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.864782 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.864935 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.865078 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.865220 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.865424 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.865641 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.865791 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.865942 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.866121 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.866279 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.866423 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.866584 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.866743 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.866886 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.867029 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.867181 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.867337 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.867491 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.867645 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.867803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.867947 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.868096 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.868248 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.868401 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.868545 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.868694 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.868845 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.868987 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.869139 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.869299 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.869470 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.869614 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.869764 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.869907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.870057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.870200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.870342 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.870490 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.870639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.870792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.870935 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.871084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.871504 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.871676 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.871830 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.871988 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.872384 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.872536 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.872688 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.872839 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.872990 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.873151 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.873367 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.873518 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.873661 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.873803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.873958 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.874109 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.874254 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.874396 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.874546 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.874701 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.874858 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.875003 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.875153 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.875296 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.875535 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.875686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.875850 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.876005 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.876150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.876300 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.876451 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.876615 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.876766 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.876910 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.877052 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.877210 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.877390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.877544 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.877688 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.877842 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.877985 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.878138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.878283 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.878439 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.878583 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.878725 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.878867 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.879018 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.879163 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.879312 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.879456 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.879612 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.879779 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.879923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.880077 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.880230 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.880374 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.880515 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.880659 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.880808 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.880965 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.881109 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.881672 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.881828 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.881984 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.882153 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.882469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.882725 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.882876 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.883020 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.883163 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.883320 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.883466 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.883610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.883753 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.883895 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.884038 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.884190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.884345 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.884500 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.884651 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.884795 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.884938 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.885089 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.885234 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.885403 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.885547 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.885689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:55:07.885912 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.886058 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.886213 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.886362 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.886508 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.886650 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.886802 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.886952 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.887102 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.887245 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.887390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.887537 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.887695 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.887839 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.887981 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.887981 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.888270 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.888427 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.889167 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.889350 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.889504 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.889649 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.889801 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.889958 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.890102 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.890245 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.890394 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.890558 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.890717 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.890875 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.891025 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.891169 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.891311 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.891480 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.891894 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.892064 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.892219 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.892383 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.892704 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.892937 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.893109 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.893273 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.893436 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.893588 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.893741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.893893 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.894049 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.894199 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.894348 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.894499 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.894649 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.894801 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.894957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.895119 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.895269 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.895419 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.895570 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.895714 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.895714 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.895996 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.896145 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.896288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.896437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.896593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.896738 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.896880 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.897034 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.897183 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.897384 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.897544 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.897695 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.897846 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.898168 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.898323 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.898467 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.898620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.898765 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.898915 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.899075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.899220 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.899371 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.899532 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.899684 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.899827 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.899969 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.900118 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.900276 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.900428 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.900571 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.900714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.900856 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.901009 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.901165 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.901356 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.901506 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.901658 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.902074 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.902232 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.902387 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.902531 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.902845 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.903097 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.903248 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.903401 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.903566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.903718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.903869 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.904019 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.904759 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.904925 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.905080 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.905231 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.905450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.905602 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.905753 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.905908 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.906052 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.906205 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.906348 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.906491 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.906633 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.906799 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.906944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.907092 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.907242 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.907393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.907536 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.907692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.907843 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.907986 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.908147 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.908298 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.908441 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.908597 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.908741 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.908882 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.909032 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.909208 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.909485 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.909650 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.909804 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.913989 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.914828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.915033 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.915209 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.915367 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.915525 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.915678 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.915823 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.915979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.916131 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.916288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.916433 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.916576 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.916719 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.916861 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.917012 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.917168 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.917396 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.917551 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.917799 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.917963 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.918109 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.918262 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.918406 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.918406 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.918694 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.918837 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.918978 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.919131 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.919283 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.919426 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.919576 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.919721 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.919895 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.920046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.920190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.920332 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.920474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.920623 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.920848 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.920994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.921144 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.921318 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.921467 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.921611 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.921767 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.921929 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.922375 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.922536 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.922681 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.922824 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.923158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.923318 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.923469 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.923613 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.923756 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.923908 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.924161 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.924320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.924475 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.924626 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.924777 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.924930 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.925074 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.925223 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.925413 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.925566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.925709 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.925861 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.926012 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.926163 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.926324 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.926469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.926611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.926762 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.926905 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.927047 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.927189 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.927337 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.927490 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.927640 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.927783 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.927932 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.928082 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.928236 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.928395 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.928548 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.928699 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.928842 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.928983 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.929125 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.929304 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.929461 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.929606 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.929747 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.929888 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.930038 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.930199 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.930350 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.930493 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.930646 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.930791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.930939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.931096 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.931247 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.931397 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.931539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.931682 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.931836 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.931836 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.932140 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.932581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.932736 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.932880 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.933056 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.933056 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.933536 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.933683 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.933826 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.933977 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.934152 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.934388 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.934544 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.934707 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.934867 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.935014 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.935167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.935312 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.935462 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.935613 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.935763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.935917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.936068 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.936219 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.936378 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.936545 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.936696 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.936841 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.936991 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.937135 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.937342 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.937510 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.937663 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.937806 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.937949 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.938092 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.938243 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.938394 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.938555 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.938706 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.938857 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.939000 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.939152 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.939303 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.939453 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.939603 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.939753 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.939910 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.940070 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.940215 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.940357 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.940521 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.940665 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.940807 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.940962 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.941108 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.941269 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.941418 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.941571 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.941726 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.941870 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.942030 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.942176 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.942326 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.942776 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.942943 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.943089 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.943239 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.943564 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.943734 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.943893 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.944048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.944200 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.944345 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.944595 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.944751 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.944954 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.945101 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.945311 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.945463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.945620 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.945772 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.945925 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.946070 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.946225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.946369 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.946519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.946663 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.946820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.946976 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.947119 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.947261 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.947412 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.947554 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.947705 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.947849 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.948007 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.948164 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.948314 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.948314 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.948608 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.948765 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.948934 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.949085 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.949260 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.949437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.949600 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.949757 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.949914 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.950071 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.950227 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.950391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.950544 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.950703 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.950853 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.951510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.951665 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.951828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.951991 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.952142 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.952291 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.952451 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.952903 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.953145 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.953342 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.953526 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.953848 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.954022 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.954187 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.954339 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.954488 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.954744 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.954901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.955051 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.955262 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.955419 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.955569 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.955720 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.955877 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.956028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.956198 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.956350 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.956507 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.956667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.956826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.956991 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.956991 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.957324 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.957490 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.957641 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.957792 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.957955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.958155 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.958155 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.958464 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.958621 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.958772 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.958937 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.959095 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.959254 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.959404 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.959553 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.959703 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.959865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.960016 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.960166 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.960405 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.960559 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.960708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.960858 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.961016 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.961166 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.961375 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.961529 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.961679 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.961828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.961989 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.962141 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.962326 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.962492 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.962643 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.963097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.963257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.963416 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.963576 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.963913 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.964080 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.964242 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.964401 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.964562 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.964729 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.964985 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.965141 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.965335 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.965493 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.965709 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.965875 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.966026 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.966215 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.966373 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.966523 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.967270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.967437 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.967588 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.967757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.967907 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.968065 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.968236 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.968389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.968545 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.968703 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.971843 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.972051 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.972226 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.972385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.972545 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.972707 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.972895 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.973406 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.973569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.973722 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.973966 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.974124 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.974286 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.974451 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.974605 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.974869 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.975129 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.975296 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.975461 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.975622 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.975777 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.975926 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.981014 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.982031 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.982210 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.982416 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.982586 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.982752 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.982909 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.983098 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.983314 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.983478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.983639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.983798 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.983969 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.984135 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.984295 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.984447 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.985170 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.985919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.986113 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.986281 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.986435 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.986605 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.986765 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.986923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.987084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.987237 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.987490 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.987648 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.987807 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.987958 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.988205 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.988363 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.988486 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.988600 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.988712 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.988823 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.988949 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.988949 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.989166 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.989300 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.989419 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.989419 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.997741 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.997855 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.998006 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.998132 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.998217 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.998309 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.998386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.998458 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.998539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.998622 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.998696 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.998778 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.998852 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.998924 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.998996 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.999069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.999141 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.999221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.999299 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.999381 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.999462 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.999536 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.999607 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.999692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.999772 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.999854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:07.999928 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.000007 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.000088 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.000169 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.000243 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.000315 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.000828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.000969 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.001110 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.001269 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.001403 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.001531 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.001660 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.001788 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.001934 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.002072 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.002202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.002331 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.002467 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.002604 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.002745 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.002883 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.002883 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.003137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.003137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.003394 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.003524 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.003652 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.003652 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.003901 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.004040 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.004183 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.004313 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.004485 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.004616 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.004755 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.004927 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.005435 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.005593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.005738 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.005883 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.006036 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.006233 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.006452 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.006452 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.007300 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.007300 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.007592 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.007746 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.007892 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.008035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.008179 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.008437 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.008630 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.008788 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.008953 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.009098 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.009263 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.009422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.009578 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.009736 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.009881 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.010023 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.010167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.010318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.010463 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.010620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.010765 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.010918 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.011069 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.011221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.011380 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.011531 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.011675 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.011826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.011970 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.012112 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.012268 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.012421 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.012573 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.012573 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.013439 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.014142 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.014308 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.014462 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.014647 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.014823 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.014975 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.015142 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.015613 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.015784 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.015937 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.016097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.016097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.016097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.016097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.016097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.016097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.016097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.016097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.017290 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.017290 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.017290 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.017290 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.017888 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.018037 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.018037 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.018354 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.018624 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.018784 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.019082 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.020403 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.020793 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.020963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.020963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.021324 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.021487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.021647 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.021812 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.021963 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.022121 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.022283 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.022484 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.022643 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.022801 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.022954 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.023616 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.023616 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.023914 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.024084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.024084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.024084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.024525 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.024691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.024843 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.025001 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.025001 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.025332 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.025857 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.026029 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.026190 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.026349 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.026512 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.026671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.026830 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.026988 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.027147 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.027147 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.027450 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.027602 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.027759 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.027953 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.028118 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.028269 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.028429 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.028622 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.028922 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.029089 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.029816 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.029989 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.030166 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.030319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.030469 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.030627 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.030627 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.030913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.031071 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.031230 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.031392 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.031550 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.031708 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.031708 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.032020 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.032179 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.032331 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.032481 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.032630 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.032861 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.033022 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.033174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.033418 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.033572 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.033572 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.033869 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.034021 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.034177 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.034327 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.034327 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.034622 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.034940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.035103 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.035262 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.035422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.035422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.036063 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.036063 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.036063 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.036513 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.036679 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.036679 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.037010 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.037200 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.037200 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.037520 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.037670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.037831 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.038008 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.038008 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.038341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.038495 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.038495 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.038791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.039053 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.039053 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.039358 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.039516 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.039765 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.039904 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.039904 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.040120 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.040276 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.040395 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.041044 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.041171 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.048023 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.048161 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.048266 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.048365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.048463 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.048463 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.048640 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.048737 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.048825 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.048919 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.049012 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.049101 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.049181 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.049303 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.049395 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.049483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.049568 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.049654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.049752 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.049840 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.049840 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.050006 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.050093 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.050173 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.050255 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.050341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.050434 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.050528 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.050616 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.050709 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.050810 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.050904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.050992 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.051085 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.051179 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.051274 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.051361 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.051454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.051454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.051611 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.051704 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.051803 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.051890 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.051983 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.052070 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.052162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.052248 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.052342 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.052453 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.052543 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.052543 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.052543 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.052773 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.052876 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.052963 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.053055 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.053141 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.053228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.053228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.053228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.053228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.053228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.053228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.053228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.053228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.058654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.058654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.058654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.058654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.058654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.058654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.058654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.058654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.059971 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.059971 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.059971 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.059971 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.059971 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.059971 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.059971 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.061232 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.061470 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.061470 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.061771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.061936 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.062096 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.062290 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.062455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.062617 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.062777 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.062938 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.062938 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.063232 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.063444 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.063609 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.063778 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.064697 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.064899 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.065076 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.065310 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.065475 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.065638 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.065803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.065959 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.066123 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.066277 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.066277 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.066816 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.066974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.067127 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.067289 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.067444 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.067598 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.067750 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.067904 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.068002 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.068105 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.068200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.068327 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.068421 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.068497 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.068582 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.068682 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.068776 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.068869 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.068956 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.069042 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.069136 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.069224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.073810 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.073967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.074069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.074165 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.074347 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.074439 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.074525 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.074631 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.074773 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.074864 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.074964 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.074964 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.075121 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.075207 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.075350 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.075483 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.075664 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.075798 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.075929 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.076595 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.076747 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.076747 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.077017 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.077157 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.077327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.077464 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.077596 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.077766 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.077870 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.077959 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.078100 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.078199 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.078287 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.078387 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.078475 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.078561 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.078646 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.078788 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.078879 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.078975 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.079069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.079156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.079241 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.079327 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.079421 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.079521 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.079521 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.079732 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.079732 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.079893 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.079993 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.080081 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.080175 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.080269 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.080364 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.080450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.080545 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.080631 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.080766 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.080857 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.080942 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.081037 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.081125 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.081280 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.081280 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.081280 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.081514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.081612 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.081700 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.081834 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.081976 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.082074 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.082161 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.082260 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.082348 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.082434 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.082521 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.082613 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.082700 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.082794 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.082877 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.082971 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.083065 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.083159 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.083259 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.083347 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.083432 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.083525 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.083611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.083697 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.083795 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.083884 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.084017 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.084141 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.084254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.084382 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.084515 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.084613 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.084707 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.084789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.084913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.085017 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.085113 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.085201 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.085350 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.085440 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.085539 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.085637 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.085733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.085865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.085969 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.086058 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.086157 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.086245 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.086331 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.086424 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.086518 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.086611 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.086707 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.086795 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.086929 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.087057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.087177 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.087302 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.087448 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.087540 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.087633 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.087721 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.087721 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.087891 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.087985 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.088079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.088205 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.088306 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.088395 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.088490 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.088586 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.088680 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.088773 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.088867 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.088967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.089063 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.089152 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.089254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.089343 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.089343 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.089502 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.089589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.089663 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.089762 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.089849 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.089983 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.090133 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.090256 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.090256 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.090478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.090594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.090705 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.090827 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.090949 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.091073 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.091186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.091298 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.091417 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.091546 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.091715 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.091839 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.091952 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.092073 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.092195 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.092319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.092434 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.092555 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.092668 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.092781 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.092902 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.093017 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.093138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.093297 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.093430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.093545 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.093668 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.093789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.093903 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.094053 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.094169 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.094290 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.094290 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.095899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.096004 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.096095 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.096191 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.096290 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.096387 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.096483 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.096578 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.096666 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.096759 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.096860 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.096949 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.097079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.097208 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.097208 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.097208 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.097208 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.097208 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.097208 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.097208 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.097208 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.097918 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.097918 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.098097 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.098186 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.098186 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.098438 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.098544 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.098641 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.098729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.098814 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.098900 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.098985 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.099080 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.099167 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.099253 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.099338 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.099423 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.099508 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.099603 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.099690 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.099776 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.099861 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.099952 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.100051 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.100134 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.100214 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.100288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.100373 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.100458 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.100552 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.100646 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:55:08.100733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.100733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.100733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.100733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.100733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.100733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.100733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.100733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101880 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101880 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101880 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101880 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101880 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101880 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101880 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.101880 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.102533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.102533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.102533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.102533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.102533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.102533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.102533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.102533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103339 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103339 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103339 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103339 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103339 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103339 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103339 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103339 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.103955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.104463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.104463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.104463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.104463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.104463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.104463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.104463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.104463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105126 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105126 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105126 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105126 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105126 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105126 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105126 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105126 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.105826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.106438 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.106438 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.106438 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.106438 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.106438 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.106438 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.106438 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.106438 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.107035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.107035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.107035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.107035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.107035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.107035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.107035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.107035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108246 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108246 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108246 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108246 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108246 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108246 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108246 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108246 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108897 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108897 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108897 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108897 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108897 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108897 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108897 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.108897 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.109634 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.109634 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.109873 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.110215 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.110542 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.110861 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.111201 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.111518 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.111841 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.112163 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.112481 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.112798 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.113118 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.113534 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.113875 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.114190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.114530 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.114884 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.115357 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.115763 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.116105 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.116430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.116768 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.117072 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.117429 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.117749 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.118088 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.118416 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.118744 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.119077 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.119412 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.119879 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.120223 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.120562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.120917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.121312 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.125490 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.125490 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.125490 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.125490 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.125490 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:55:08.125490 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130229) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:55:08.136347 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO dbcounter [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] Registered counter for database nova_api Jun 16 18:55:08.155919 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_db.sqlalchemy.engines [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:55:08.162459 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writer thread running {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:55:08.189511 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO dbcounter [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] Registered counter for database nova_api Jun 16 18:55:08.210157 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_db.sqlalchemy.engines [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:55:08.216982 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writer thread running {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:55:08.219708 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.context [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),09ff3e34-0387-4a9f-a89a-c712eae3ab25(cell1) {{(pid=130230) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:55:08.223849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:08.225446 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:08.226258 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:08.228454 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:08.230470 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO dbcounter [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] Registered counter for database nova_cell0 Jun 16 18:55:08.234824 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO dbcounter [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] Registered counter for database nova_cell1 Jun 16 18:55:08.242142 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_db.sqlalchemy.engines [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:55:08.243955 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_db.sqlalchemy.engines [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:55:08.251182 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writer thread running {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:55:08.251521 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writer thread running {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:55:08.275480 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.context [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),09ff3e34-0387-4a9f-a89a-c712eae3ab25(cell1) {{(pid=130229) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:55:08.280155 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:08.281757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:08.282579 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:55:08.284527 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:55:08.286538 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO dbcounter [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] Registered counter for database nova_cell0 Jun 16 18:55:08.290370 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO dbcounter [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] Registered counter for database nova_cell1 Jun 16 18:55:08.298145 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_db.sqlalchemy.engines [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:55:08.300417 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_db.sqlalchemy.engines [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:55:08.305854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writer thread running {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:55:08.308165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writer thread running {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:55:08.397749 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO dbcounter [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] Registered counter for database nova_cell0 Jun 16 18:55:08.404823 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_db.sqlalchemy.engines [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:55:08.409129 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writer thread running {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:55:08.458108 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO dbcounter [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] Registered counter for database nova_cell0 Jun 16 18:55:08.464614 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_db.sqlalchemy.engines [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130229) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:55:08.469601 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writer thread running {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:55:08.724952 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: WARNING keystonemiddleware.auth_token [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:55:08.732671 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: WARNING keystonemiddleware.auth_token [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:55:08.795355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: WARNING keystonemiddleware.auth_token [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:55:08.802657 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: WARNING keystonemiddleware.auth_token [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:55:09.076775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: WARNING keystonemiddleware.auth_token [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:55:09.082667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: WARNING keystonemiddleware.auth_token [None req-2173720b-27e0-4eb1-a4a2-d24f3a890ffe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:55:09.088131 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5571f3a959c0 pid: 130230 (default app) Jun 16 18:55:09.151972 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: WARNING keystonemiddleware.auth_token [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:55:09.158549 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: WARNING keystonemiddleware.auth_token [None req-cca9b883-fb94-45fe-98d2-aa202be70645 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:55:09.163921 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5571f3a959c0 pid: 130229 (default app) Jun 16 18:55:58.485562 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=3 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:58.486736 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=3 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:58.487467 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=3 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:58.488199 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=3 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:55:59.692368 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d1301053-a4d9-4d8c-a5aa-a1da5e3f992a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Action: 'create', calling method: .version_select at 0x7f2015fb38b0>, body: {"keypair": {"name": "tempest-keypair-74238525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqf7QNBxX712hov56NzKKXWTeVsBVlWJ67hdOWfOcoq7tKlc/ABykyavqI/bmqS1mIW0mS3vJh5DCbRHrxPEiX+ZTwVqol8rpIIFfDU86g7ti/w5EfhdJPKXtmxsJ9QcQ=="}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:55:59.755151 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-d1301053-a4d9-4d8c-a5aa-a1da5e3f992a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Getting quotas for project f9e5f71068aa4d75bcc4578b741f490d. Resources: {'key_pairs'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:55:59.774805 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-d1301053-a4d9-4d8c-a5aa-a1da5e3f992a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Getting quotas for user fec4e3ac2e44403b9d45b37b5a6f64a9 and project f9e5f71068aa4d75bcc4578b741f490d. Resources: {'key_pairs'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:55:59.978688 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d1301053-a4d9-4d8c-a5aa-a1da5e3f992a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.499084 Jun 16 18:55:59.979666 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 1/1] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jun 16 18:55:58 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:56:05.659207 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=3 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:05.660906 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=3 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:05.663657 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=3 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:05.669694 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=3 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:06.651606 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-286403047", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "networks": [{"uuid": "d23e2e97-5f79-4bb3-a50a-cf2c8a9fc959"}]}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:07.102703 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-412404517", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:07.170924 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.network.neutron [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] validate_networks() for [('d23e2e97-5f79-4bb3-a50a-cf2c8a9fc959', None, None, None, None, None)] {{(pid=130229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:56:07.554179 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.network.neutron [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] validate_networks() for [('9f034df0-3327-47b9-8a71-7606258bf90a', None, None, None, None, None)] {{(pid=130230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:56:09.095076 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Flavor limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:56:09.097644 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Flavor limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:56:09.099065 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Image limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:56:09.100496 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Image limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:56:09.103544 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Flavor pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:56:09.104366 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Flavor pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:56:09.104475 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Image pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:56:09.105146 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Image pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:56:09.107772 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:56:09.109159 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:56:09.143166 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:09.149094 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:09.150106 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:09.151414 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:09.165174 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:09.170725 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:09.170725 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:09.173609 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:09.230888 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Getting quotas for project ed8501d1ff734054ba0a6ef4c398d051. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:56:09.246007 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Getting quotas for user 7310c631282c495a83e17dbdbc6d2ba0 and project ed8501d1ff734054ba0a6ef4c398d051. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:56:09.260792 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Going to run 1 instances... {{(pid=130230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:56:09.264863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:56:09.265051 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Getting quotas for project 57f75a8c58e340a1bba335f7463c03a1. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:56:09.276274 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Getting quotas for user 1052dda92d1a4597be43a7acdcd06905 and project 57f75a8c58e340a1bba335f7463c03a1. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:56:09.307261 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Going to run 1 instances... {{(pid=130229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:56:09.314698 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:56:09.510184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3ab74699-350d-40e6-91c7-173add930432 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.562287 Jun 16 18:56:09.516520 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 2/2] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 18:56:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 2569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:56:09.538793 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2075921933", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64614a18-07e0-43ad-9990-55ab159f858f"}], "security_groups": [{"name": "tempest-securitygroup--779116486"}], "key_name": "tempest-keypair-74238525", "user_data": "}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:09.561567 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c46fb896-00bd-458b-b6ac-206ca7da4a79 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.908564 Jun 16 18:56:09.562533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 1/3] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 18:56:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:56:09.847793 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.network.neutron [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] validate_networks() for [('64614a18-07e0-43ad-9990-55ab159f858f', None, None, None, None, None)] {{(pid=130230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:56:10.141628 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-672da8ad-b03c-4a88-87f5-47aa6986a1c4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Action: 'create', calling method: .version_select at 0x7f20155a95e0>, body: {"keypair": {"name": "tempest-keypair-910238746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwWr1QwqMVu7ctdQhMQC8LxfSo0S+YqmKcsTeDEjvHHstGMXu7Hv3tKwajX1ghtEtcwucb+60FRcOkhVVoN0zGZL37vVYYtM8/eJ8qTFIJIkblYxEdVira1Ui/z/+rjvQ=="}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:10.195700 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-672da8ad-b03c-4a88-87f5-47aa6986a1c4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Getting quotas for project 0b607bd5abec4c72842e250a639f99f1. Resources: {'key_pairs'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:56:10.209347 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-672da8ad-b03c-4a88-87f5-47aa6986a1c4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Getting quotas for user 2de523abbc7b4f8b972dc97b8a013237 and project 0b607bd5abec4c72842e250a639f99f1. Resources: {'key_pairs'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:56:10.410719 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-672da8ad-b03c-4a88-87f5-47aa6986a1c4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.846492 Jun 16 18:56:10.412035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 2/4] 10.222.0.81 () {62 vars in 1199 bytes} [Thu Jun 16 18:56:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 848 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 18:56:10.433959 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c077c8af-c5b7-4f38-941e-2af6db9c7590 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:10.436242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c077c8af-c5b7-4f38-941e-2af6db9c7590 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:10.949842 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c077c8af-c5b7-4f38-941e-2af6db9c7590 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:10.987367 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c077c8af-c5b7-4f38-941e-2af6db9c7590 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1221 microversion: 2.1 time: 0.571337 Jun 16 18:56:10.988630 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 3/5] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:10 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1221 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:11.013146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b6ad3a97-7ab8-41c9-a114-1d7cfb71d265 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:11.014858 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b6ad3a97-7ab8-41c9-a114-1d7cfb71d265 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:11.296102 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b6ad3a97-7ab8-41c9-a114-1d7cfb71d265 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:11.306058 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b6ad3a97-7ab8-41c9-a114-1d7cfb71d265 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1214 microversion: 2.1 time: 0.314477 Jun 16 18:56:11.309770 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 4/6] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:10 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1214 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:11.353776 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-957982960", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:11.477820 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.network.neutron [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] validate_networks() for [('9f034df0-3327-47b9-8a71-7606258bf90a', None, None, None, None, None)] {{(pid=130229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:56:11.689640 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Flavor limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:56:11.689640 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Image limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:56:11.690660 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Flavor pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:56:11.691228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Image pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:56:11.691821 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:56:11.707523 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:11.708162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:11.710279 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:11.712020 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:11.753544 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Getting quotas for project f9e5f71068aa4d75bcc4578b741f490d. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:56:11.758111 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Getting quotas for user fec4e3ac2e44403b9d45b37b5a6f64a9 and project f9e5f71068aa4d75bcc4578b741f490d. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:56:11.783605 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Going to run 1 instances... {{(pid=130230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:56:11.792062 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:56:12.009469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9b32e0ce-db30-494e-9449-555d719200f3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.490624 Jun 16 18:56:12.013329 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 3/7] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 18:56:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 2496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:56:12.035346 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-082f8a16-f1fc-4fb4-9569-728c0480ead3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:12.041966 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-082f8a16-f1fc-4fb4-9569-728c0480ead3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:12.516957 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-082f8a16-f1fc-4fb4-9569-728c0480ead3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:12.546019 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-082f8a16-f1fc-4fb4-9569-728c0480ead3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1236 microversion: 2.1 time: 0.526295 Jun 16 18:56:12.556247 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 4/8] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:12 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1236 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:12.574167 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Flavor limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:56:12.574167 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Image limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:56:12.574167 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Flavor pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:56:12.574167 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Image pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:56:12.575038 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-170b262b-eb03-4246-948c-adfeaba3094e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:12.575131 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:56:12.575212 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-170b262b-eb03-4246-948c-adfeaba3094e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:12.577803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:12.578302 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:12.589687 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:12.589687 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:12.629587 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Getting quotas for project ed8501d1ff734054ba0a6ef4c398d051. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:56:12.637278 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Getting quotas for user 7310c631282c495a83e17dbdbc6d2ba0 and project ed8501d1ff734054ba0a6ef4c398d051. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:56:12.656004 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Going to run 1 instances... {{(pid=130229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:56:12.658608 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:56:12.684942 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-170b262b-eb03-4246-948c-adfeaba3094e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:12.696100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-170b262b-eb03-4246-948c-adfeaba3094e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1214 microversion: 2.1 time: 0.137874 Jun 16 18:56:12.698514 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 5/9] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:12 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:12.874149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e2d36daf-7a96-4ea3-b4e0-fa919f83e1fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.560357 Jun 16 18:56:12.874811 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 5/10] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 18:56:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:56:12.886452 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e9cfab2c-ffa3-4654-bedf-07ec9a5a86a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:12.887718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e9cfab2c-ffa3-4654-bedf-07ec9a5a86a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:13.057095 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e9cfab2c-ffa3-4654-bedf-07ec9a5a86a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:13.114304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e9cfab2c-ffa3-4654-bedf-07ec9a5a86a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1221 microversion: 2.1 time: 0.231147 Jun 16 18:56:13.117558 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 6/11] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:12 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1221 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:13.565915 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8d541340-302e-412f-bfd3-366400ead3ce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:13.566547 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8d541340-302e-412f-bfd3-366400ead3ce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:13.680077 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8d541340-302e-412f-bfd3-366400ead3ce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:13.691897 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8d541340-302e-412f-bfd3-366400ead3ce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1236 microversion: 2.1 time: 0.130827 Jun 16 18:56:13.693042 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 6/12] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:13 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1236 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:13.720250 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-986bd67e-7e4a-45a6-8a20-ff3351f7af1a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:13.722680 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-986bd67e-7e4a-45a6-8a20-ff3351f7af1a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:13.736590 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-986bd67e-7e4a-45a6-8a20-ff3351f7af1a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:13.736590 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-986bd67e-7e4a-45a6-8a20-ff3351f7af1a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:13.736590 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-986bd67e-7e4a-45a6-8a20-ff3351f7af1a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:13.736590 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-986bd67e-7e4a-45a6-8a20-ff3351f7af1a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:14.134046 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-10889f9c-abb0-4451-b6b7-511c090e36fc tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:14.136858 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-10889f9c-abb0-4451-b6b7-511c090e36fc tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:14.142995 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-986bd67e-7e4a-45a6-8a20-ff3351f7af1a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:14.183391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-986bd67e-7e4a-45a6-8a20-ff3351f7af1a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1210 microversion: 2.1 time: 0.466904 Jun 16 18:56:14.185999 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 7/13] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:13 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1210 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:14.238851 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-10889f9c-abb0-4451-b6b7-511c090e36fc tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:14.252172 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-10889f9c-abb0-4451-b6b7-511c090e36fc tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1221 microversion: 2.1 time: 0.121081 Jun 16 18:56:14.263479 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 7/14] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:14 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1221 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:14.672292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-561222088", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b63c6cac-d1b4-42bd-9dde-7d5291a4c111"}], "security_groups": [{"name": "tempest-securitygroup--1650448115"}], "key_name": "tempest-keypair-910238746", "user_data": "}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:14.709795 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9c26fc21-c5dd-49e9-985d-ec95e42c4a44 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:14.710512 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9c26fc21-c5dd-49e9-985d-ec95e42c4a44 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:14.720110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9c26fc21-c5dd-49e9-985d-ec95e42c4a44 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:14.722431 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9c26fc21-c5dd-49e9-985d-ec95e42c4a44 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:14.725110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9c26fc21-c5dd-49e9-985d-ec95e42c4a44 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:14.726025 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9c26fc21-c5dd-49e9-985d-ec95e42c4a44 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:14.842110 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.network.neutron [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] validate_networks() for [('b63c6cac-d1b4-42bd-9dde-7d5291a4c111', None, None, None, None, None)] {{(pid=130230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:56:14.909889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9c26fc21-c5dd-49e9-985d-ec95e42c4a44 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:14.938075 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9c26fc21-c5dd-49e9-985d-ec95e42c4a44 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1232 microversion: 2.1 time: 0.232675 Jun 16 18:56:14.938911 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 8/15] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:14 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1232 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:15.205225 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-dbd377d9-dad6-4880-b156-742cb77de52d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:15.205970 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-dbd377d9-dad6-4880-b156-742cb77de52d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:15.231170 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dbd377d9-dad6-4880-b156-742cb77de52d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:15.231619 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dbd377d9-dad6-4880-b156-742cb77de52d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:15.232707 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dbd377d9-dad6-4880-b156-742cb77de52d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:15.233192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dbd377d9-dad6-4880-b156-742cb77de52d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:15.377540 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-dbd377d9-dad6-4880-b156-742cb77de52d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:15.407949 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-dbd377d9-dad6-4880-b156-742cb77de52d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1274 microversion: 2.1 time: 0.208396 Jun 16 18:56:15.411082 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 9/16] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:15 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:15.418705 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-23df0ba1-f1ae-4bf5-80cc-79b11cb9a10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:15.419638 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-23df0ba1-f1ae-4bf5-80cc-79b11cb9a10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:15.429861 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-23df0ba1-f1ae-4bf5-80cc-79b11cb9a10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:15.432128 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-23df0ba1-f1ae-4bf5-80cc-79b11cb9a10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:15.432128 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-23df0ba1-f1ae-4bf5-80cc-79b11cb9a10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:15.432842 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-23df0ba1-f1ae-4bf5-80cc-79b11cb9a10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:15.531814 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Flavor limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:56:15.532553 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Image limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:56:15.532965 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Flavor pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:56:15.533421 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Image pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:56:15.533857 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:56:15.547701 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:15.548452 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:15.549588 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:15.550665 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:15.584448 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Getting quotas for project 0b607bd5abec4c72842e250a639f99f1. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:56:15.589208 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Getting quotas for user 2de523abbc7b4f8b972dc97b8a013237 and project 0b607bd5abec4c72842e250a639f99f1. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:56:15.637083 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Going to run 1 instances... {{(pid=130230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:56:15.642470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-23df0ba1-f1ae-4bf5-80cc-79b11cb9a10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:15.646030 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:56:15.655975 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-23df0ba1-f1ae-4bf5-80cc-79b11cb9a10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1273 microversion: 2.1 time: 0.243651 Jun 16 18:56:15.662140 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 10/17] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:15 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1273 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:15.885368 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6fb25820-240e-4480-8743-caca962cd852 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.217321 Jun 16 18:56:15.889507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 8/18] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jun 16 18:56:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:56:15.897522 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9883b719-36a5-4966-a786-93c29fea0cd1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:15.898150 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9883b719-36a5-4966-a786-93c29fea0cd1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:15.964337 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-21a99a0d-64bb-4079-a65a-70c6050b8e0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:15.966800 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-21a99a0d-64bb-4079-a65a-70c6050b8e0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:16.014319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-21a99a0d-64bb-4079-a65a-70c6050b8e0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:16.018665 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-21a99a0d-64bb-4079-a65a-70c6050b8e0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:16.022564 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-21a99a0d-64bb-4079-a65a-70c6050b8e0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:16.023236 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-21a99a0d-64bb-4079-a65a-70c6050b8e0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:16.146034 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9883b719-36a5-4966-a786-93c29fea0cd1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:16.155143 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9883b719-36a5-4966-a786-93c29fea0cd1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:16.157715 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9883b719-36a5-4966-a786-93c29fea0cd1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:16.164086 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9883b719-36a5-4966-a786-93c29fea0cd1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1280 microversion: 2.20 time: 0.271061 Jun 16 18:56:16.175049 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 11/19] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:15 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:16.176215 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-21a99a0d-64bb-4079-a65a-70c6050b8e0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:16.185728 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-21a99a0d-64bb-4079-a65a-70c6050b8e0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1296 microversion: 2.1 time: 0.226991 Jun 16 18:56:16.186312 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 9/20] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:15 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1296 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:16.427134 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-777a9b01-322c-40d8-bb4c-0adaea63e150 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:16.427762 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-777a9b01-322c-40d8-bb4c-0adaea63e150 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:16.449375 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-777a9b01-322c-40d8-bb4c-0adaea63e150 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:16.449835 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-777a9b01-322c-40d8-bb4c-0adaea63e150 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:16.450625 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-777a9b01-322c-40d8-bb4c-0adaea63e150 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:16.451309 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-777a9b01-322c-40d8-bb4c-0adaea63e150 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:16.680813 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b3bbdeb8-d3d0-4f40-bced-a71093c6fef8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:16.681754 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b3bbdeb8-d3d0-4f40-bced-a71093c6fef8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:16.693796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b3bbdeb8-d3d0-4f40-bced-a71093c6fef8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:16.694494 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b3bbdeb8-d3d0-4f40-bced-a71093c6fef8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:16.695613 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b3bbdeb8-d3d0-4f40-bced-a71093c6fef8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:16.696565 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b3bbdeb8-d3d0-4f40-bced-a71093c6fef8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:16.931415 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-777a9b01-322c-40d8-bb4c-0adaea63e150 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:16.940623 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-777a9b01-322c-40d8-bb4c-0adaea63e150 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1272 microversion: 2.1 time: 0.517258 Jun 16 18:56:16.951679 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 12/21] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:16 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1272 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:17.123520 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b3bbdeb8-d3d0-4f40-bced-a71093c6fef8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:17.138219 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b3bbdeb8-d3d0-4f40-bced-a71093c6fef8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1291 microversion: 2.1 time: 0.459816 Jun 16 18:56:17.138219 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 10/22] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:16 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1291 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:17.185368 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8b0d2d68-5dd3-4f3f-82d5-c817933be3f9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:17.186668 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8b0d2d68-5dd3-4f3f-82d5-c817933be3f9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:17.203212 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-68284a60-f738-4b52-8bc7-dbc491166b38 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:17.204085 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-68284a60-f738-4b52-8bc7-dbc491166b38 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:17.211076 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-68284a60-f738-4b52-8bc7-dbc491166b38 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:17.211966 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-68284a60-f738-4b52-8bc7-dbc491166b38 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:17.212892 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-68284a60-f738-4b52-8bc7-dbc491166b38 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:17.213512 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-68284a60-f738-4b52-8bc7-dbc491166b38 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:17.574568 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-68284a60-f738-4b52-8bc7-dbc491166b38 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:17.586536 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-68284a60-f738-4b52-8bc7-dbc491166b38 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1294 microversion: 2.1 time: 0.387848 Jun 16 18:56:17.599352 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 11/23] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:17 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1294 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:17.694827 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8b0d2d68-5dd3-4f3f-82d5-c817933be3f9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:17.723236 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8b0d2d68-5dd3-4f3f-82d5-c817933be3f9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:17.735206 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8b0d2d68-5dd3-4f3f-82d5-c817933be3f9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:17.740712 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8b0d2d68-5dd3-4f3f-82d5-c817933be3f9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1280 microversion: 2.20 time: 0.557692 Jun 16 18:56:17.743770 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 13/24] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:17 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1280 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:17.960653 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-aa936a50-ac27-4e19-a7bb-93fc7597f9bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:17.961546 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-aa936a50-ac27-4e19-a7bb-93fc7597f9bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:17.984798 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aa936a50-ac27-4e19-a7bb-93fc7597f9bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:17.985296 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aa936a50-ac27-4e19-a7bb-93fc7597f9bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:17.986300 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aa936a50-ac27-4e19-a7bb-93fc7597f9bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:17.987088 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aa936a50-ac27-4e19-a7bb-93fc7597f9bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:18.153866 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f12c1fc3-6975-4790-bc9a-aacdd5fea10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:18.154561 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f12c1fc3-6975-4790-bc9a-aacdd5fea10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:18.168269 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f12c1fc3-6975-4790-bc9a-aacdd5fea10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:18.171472 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f12c1fc3-6975-4790-bc9a-aacdd5fea10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:18.173600 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f12c1fc3-6975-4790-bc9a-aacdd5fea10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:18.183196 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f12c1fc3-6975-4790-bc9a-aacdd5fea10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:18.442242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f12c1fc3-6975-4790-bc9a-aacdd5fea10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:18.460206 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f12c1fc3-6975-4790-bc9a-aacdd5fea10e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1279 microversion: 2.1 time: 0.308770 Jun 16 18:56:18.465179 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 14/25] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:18 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1279 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:18.579343 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-aa936a50-ac27-4e19-a7bb-93fc7597f9bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:18.609713 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-91ad1963-3b07-4888-bb97-9a4b39292cf3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:18.610784 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-91ad1963-3b07-4888-bb97-9a4b39292cf3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:18.615387 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-aa936a50-ac27-4e19-a7bb-93fc7597f9bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.660737 Jun 16 18:56:18.623180 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-91ad1963-3b07-4888-bb97-9a4b39292cf3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:18.623957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-91ad1963-3b07-4888-bb97-9a4b39292cf3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:18.625275 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-91ad1963-3b07-4888-bb97-9a4b39292cf3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:18.626145 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-91ad1963-3b07-4888-bb97-9a4b39292cf3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:18.633591 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 12/26] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:17 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:18.763142 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c39d13ca-933a-4800-a24f-121ff081edaa tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:18.765099 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-c39d13ca-933a-4800-a24f-121ff081edaa tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:18.779746 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c39d13ca-933a-4800-a24f-121ff081edaa tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:18.780207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c39d13ca-933a-4800-a24f-121ff081edaa tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:18.781027 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c39d13ca-933a-4800-a24f-121ff081edaa tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:18.781497 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c39d13ca-933a-4800-a24f-121ff081edaa tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:18.866861 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-91ad1963-3b07-4888-bb97-9a4b39292cf3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:18.888133 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-91ad1963-3b07-4888-bb97-9a4b39292cf3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1294 microversion: 2.1 time: 0.283452 Jun 16 18:56:18.889213 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 15/27] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:18 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1294 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:19.379734 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c39d13ca-933a-4800-a24f-121ff081edaa tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:19.416409 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c39d13ca-933a-4800-a24f-121ff081edaa tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:19.432122 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c39d13ca-933a-4800-a24f-121ff081edaa tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:19.434409 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-c39d13ca-933a-4800-a24f-121ff081edaa tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1276 microversion: 2.20 time: 0.674848 Jun 16 18:56:19.435630 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 13/28] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:18 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1276 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:56:19.480984 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-830bfd4c-c85c-4b59-98f1-2688930834cd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:19.482952 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-830bfd4c-c85c-4b59-98f1-2688930834cd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:19.499263 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-830bfd4c-c85c-4b59-98f1-2688930834cd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:19.501738 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-830bfd4c-c85c-4b59-98f1-2688930834cd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:19.505340 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-830bfd4c-c85c-4b59-98f1-2688930834cd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:19.507808 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-830bfd4c-c85c-4b59-98f1-2688930834cd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:19.640847 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f2564100-b6b7-4a99-a92d-f646cebef9d5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:19.642132 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f2564100-b6b7-4a99-a92d-f646cebef9d5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:19.654418 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f2564100-b6b7-4a99-a92d-f646cebef9d5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:19.656627 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f2564100-b6b7-4a99-a92d-f646cebef9d5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:19.657562 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f2564100-b6b7-4a99-a92d-f646cebef9d5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:19.661653 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f2564100-b6b7-4a99-a92d-f646cebef9d5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:19.762784 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-830bfd4c-c85c-4b59-98f1-2688930834cd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:19.775109 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-830bfd4c-c85c-4b59-98f1-2688930834cd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1279 microversion: 2.1 time: 0.297531 Jun 16 18:56:19.776808 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 16/29] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:19 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1279 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:19.912436 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-70b59498-6fa8-423a-8a0a-45935b33edc8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:19.913147 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-70b59498-6fa8-423a-8a0a-45935b33edc8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:19.929093 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-70b59498-6fa8-423a-8a0a-45935b33edc8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:19.938755 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-70b59498-6fa8-423a-8a0a-45935b33edc8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:19.941692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-70b59498-6fa8-423a-8a0a-45935b33edc8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:19.946816 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-70b59498-6fa8-423a-8a0a-45935b33edc8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:20.590811 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f2564100-b6b7-4a99-a92d-f646cebef9d5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:20.599674 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f2564100-b6b7-4a99-a92d-f646cebef9d5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.967410 Jun 16 18:56:20.613253 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 14/30] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:19 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:20.643366 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d507afbe-6d50-4d79-b44f-0b92525bca12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:20.644021 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d507afbe-6d50-4d79-b44f-0b92525bca12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:20.649424 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-70b59498-6fa8-423a-8a0a-45935b33edc8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:20.662285 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-70b59498-6fa8-423a-8a0a-45935b33edc8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.755704 Jun 16 18:56:20.667468 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 17/31] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:19 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:20.677795 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d507afbe-6d50-4d79-b44f-0b92525bca12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:20.678938 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d507afbe-6d50-4d79-b44f-0b92525bca12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:20.681788 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d507afbe-6d50-4d79-b44f-0b92525bca12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:20.683164 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d507afbe-6d50-4d79-b44f-0b92525bca12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:20.795310 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9116b653-e8ed-4c30-89e3-e9b2a387f8c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:20.796891 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9116b653-e8ed-4c30-89e3-e9b2a387f8c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:20.815836 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9116b653-e8ed-4c30-89e3-e9b2a387f8c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:20.823899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9116b653-e8ed-4c30-89e3-e9b2a387f8c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:20.825132 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9116b653-e8ed-4c30-89e3-e9b2a387f8c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:20.826801 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9116b653-e8ed-4c30-89e3-e9b2a387f8c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:21.175503 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d507afbe-6d50-4d79-b44f-0b92525bca12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:21.206505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d507afbe-6d50-4d79-b44f-0b92525bca12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:21.214456 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d507afbe-6d50-4d79-b44f-0b92525bca12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:21.221142 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d507afbe-6d50-4d79-b44f-0b92525bca12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1340 microversion: 2.20 time: 0.596761 Jun 16 18:56:21.224208 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 15/32] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:20 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1340 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:21.633016 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-43a5a88a-71a6-4aaf-98e2-d43634b26f97 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:21.633879 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-43a5a88a-71a6-4aaf-98e2-d43634b26f97 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:21.658945 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-43a5a88a-71a6-4aaf-98e2-d43634b26f97 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:21.661489 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-43a5a88a-71a6-4aaf-98e2-d43634b26f97 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:21.670041 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-43a5a88a-71a6-4aaf-98e2-d43634b26f97 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:21.670786 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-43a5a88a-71a6-4aaf-98e2-d43634b26f97 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:22.605486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=4 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:22.834765 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9116b653-e8ed-4c30-89e3-e9b2a387f8c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:22.849186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9116b653-e8ed-4c30-89e3-e9b2a387f8c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 2.059038 Jun 16 18:56:22.852023 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 18/33] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:20 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 2063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:22.862115 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-506a31df-5d52-450f-b4af-cba86be974e8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:22.863251 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-506a31df-5d52-450f-b4af-cba86be974e8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:22.872115 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-506a31df-5d52-450f-b4af-cba86be974e8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:22.876205 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-506a31df-5d52-450f-b4af-cba86be974e8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:22.876205 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-506a31df-5d52-450f-b4af-cba86be974e8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:22.876205 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-506a31df-5d52-450f-b4af-cba86be974e8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:23.003272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-43a5a88a-71a6-4aaf-98e2-d43634b26f97 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:23.022989 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-43a5a88a-71a6-4aaf-98e2-d43634b26f97 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 1.385123 Jun 16 18:56:23.023663 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 16/34] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:21 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:23.043079 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-33b3d22f-f390-4295-85ee-1207106bd46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:23.045049 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-33b3d22f-f390-4295-85ee-1207106bd46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:23.054576 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-33b3d22f-f390-4295-85ee-1207106bd46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:23.055263 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-33b3d22f-f390-4295-85ee-1207106bd46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:23.056256 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-33b3d22f-f390-4295-85ee-1207106bd46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:23.056896 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-33b3d22f-f390-4295-85ee-1207106bd46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:23.427938 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-33b3d22f-f390-4295-85ee-1207106bd46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:23.441319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-33b3d22f-f390-4295-85ee-1207106bd46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:23.442836 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-33b3d22f-f390-4295-85ee-1207106bd46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:23.444194 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-33b3d22f-f390-4295-85ee-1207106bd46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1338 microversion: 2.20 time: 0.408404 Jun 16 18:56:23.444752 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 17/35] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:23 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1338 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:23.674142 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-22957ea6-0ad0-4019-b0e1-b3008f49989a req-88b7ba04-75d8-4807-813f-deefb96800a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "544e6615-4246-45d4-bd9b-18a4ab137989", "tag": "c03f9164-b914-4183-b673-f6b558f696da"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:23.723448 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-22957ea6-0ad0-4019-b0e1-b3008f49989a req-88b7ba04-75d8-4807-813f-deefb96800a9 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:23.726638 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-22957ea6-0ad0-4019-b0e1-b3008f49989a req-88b7ba04-75d8-4807-813f-deefb96800a9 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:23.788232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-22957ea6-0ad0-4019-b0e1-b3008f49989a req-88b7ba04-75d8-4807-813f-deefb96800a9 service nova] Creating event network-changed:c03f9164-b914-4183-b673-f6b558f696da for instance 544e6615-4246-45d4-bd9b-18a4ab137989 on hv-cinder-84617 Jun 16 18:56:23.789438 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-22957ea6-0ad0-4019-b0e1-b3008f49989a req-88b7ba04-75d8-4807-813f-deefb96800a9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:56:23.792107 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-df55c5f1-9af4-4c8e-a7a2-44c8a02c0864 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:23.793618 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-df55c5f1-9af4-4c8e-a7a2-44c8a02c0864 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:23.804790 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-df55c5f1-9af4-4c8e-a7a2-44c8a02c0864 None None] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:23.804790 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-df55c5f1-9af4-4c8e-a7a2-44c8a02c0864 None None] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:23.821213 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.compute.rpcapi [None req-df55c5f1-9af4-4c8e-a7a2-44c8a02c0864 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 18:56:23.824602 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-df55c5f1-9af4-4c8e-a7a2-44c8a02c0864 None None] Releasing lock "compute-rpcapi-router" {{(pid=130230) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:56:23.867747 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-df55c5f1-9af4-4c8e-a7a2-44c8a02c0864 None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.409221 Jun 16 18:56:23.868897 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 18/36] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:56:23.882119 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4c83c203-a5a0-48a5-ad7c-0f2490b91136 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:23.885562 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4c83c203-a5a0-48a5-ad7c-0f2490b91136 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:23.901172 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:23.903391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c83c203-a5a0-48a5-ad7c-0f2490b91136 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:23.903851 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c83c203-a5a0-48a5-ad7c-0f2490b91136 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:23.904638 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c83c203-a5a0-48a5-ad7c-0f2490b91136 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:23.905075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c83c203-a5a0-48a5-ad7c-0f2490b91136 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:24.047430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-506a31df-5d52-450f-b4af-cba86be974e8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:24.060588 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-506a31df-5d52-450f-b4af-cba86be974e8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 1.203566 Jun 16 18:56:24.062532 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 19/37] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:22 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:24.086991 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-710d4176-3c4c-4146-9633-cae86bc6f227 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:24.086991 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-710d4176-3c4c-4146-9633-cae86bc6f227 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:24.100680 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-710d4176-3c4c-4146-9633-cae86bc6f227 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:24.107641 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-710d4176-3c4c-4146-9633-cae86bc6f227 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:24.108827 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-710d4176-3c4c-4146-9633-cae86bc6f227 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:24.112357 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-710d4176-3c4c-4146-9633-cae86bc6f227 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:24.829842 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4c83c203-a5a0-48a5-ad7c-0f2490b91136 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:24.837776 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4c83c203-a5a0-48a5-ad7c-0f2490b91136 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.967327 Jun 16 18:56:24.857597 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 19/38] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:23 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:24.863099 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b1e23a38-5877-4539-af03-76fca50636c6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:24.863729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b1e23a38-5877-4539-af03-76fca50636c6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:24.882804 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b1e23a38-5877-4539-af03-76fca50636c6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:24.883277 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b1e23a38-5877-4539-af03-76fca50636c6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:24.884083 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b1e23a38-5877-4539-af03-76fca50636c6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:24.884585 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b1e23a38-5877-4539-af03-76fca50636c6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:24.984738 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-710d4176-3c4c-4146-9633-cae86bc6f227 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:24.996348 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-710d4176-3c4c-4146-9633-cae86bc6f227 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.920898 Jun 16 18:56:24.998019 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 20/39] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:24 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:25.078705 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9544f61a-fd44-4c01-8bfb-df9eb5d5657b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:25.079361 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9544f61a-fd44-4c01-8bfb-df9eb5d5657b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:25.096106 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9544f61a-fd44-4c01-8bfb-df9eb5d5657b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:25.096579 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9544f61a-fd44-4c01-8bfb-df9eb5d5657b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:25.097470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9544f61a-fd44-4c01-8bfb-df9eb5d5657b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:25.097882 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9544f61a-fd44-4c01-8bfb-df9eb5d5657b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:25.314520 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b1e23a38-5877-4539-af03-76fca50636c6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:25.325592 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b1e23a38-5877-4539-af03-76fca50636c6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:25.327647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b1e23a38-5877-4539-af03-76fca50636c6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:25.339919 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b1e23a38-5877-4539-af03-76fca50636c6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1338 microversion: 2.20 time: 0.480738 Jun 16 18:56:25.344150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 20/40] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:24 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1338 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:25.854801 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-43f187e5-92d0-4ceb-8c20-3167090fe69d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:25.856227 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-43f187e5-92d0-4ceb-8c20-3167090fe69d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:25.859332 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=28 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:25.884784 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-43f187e5-92d0-4ceb-8c20-3167090fe69d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:25.887616 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-43f187e5-92d0-4ceb-8c20-3167090fe69d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:25.891674 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-43f187e5-92d0-4ceb-8c20-3167090fe69d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:25.893135 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-43f187e5-92d0-4ceb-8c20-3167090fe69d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:25.950653 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9544f61a-fd44-4c01-8bfb-df9eb5d5657b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:25.966293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9544f61a-fd44-4c01-8bfb-df9eb5d5657b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.890297 Jun 16 18:56:25.979853 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 21/41] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:25 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:25.996043 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-358067dc-5523-4076-afad-5636594157e6 req-7f648d20-91bd-42ad-b276-0b82b338590f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25fe61a4-e1c1-4098-91db-fbb42c8b1d7b", "tag": "3e4f94ae-ac05-441d-a1fa-fa6601b9d389"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:26.013083 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-358067dc-5523-4076-afad-5636594157e6 req-7f648d20-91bd-42ad-b276-0b82b338590f service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:26.018915 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-358067dc-5523-4076-afad-5636594157e6 req-7f648d20-91bd-42ad-b276-0b82b338590f service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:26.058286 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-358067dc-5523-4076-afad-5636594157e6 req-7f648d20-91bd-42ad-b276-0b82b338590f service nova] Creating event network-changed:3e4f94ae-ac05-441d-a1fa-fa6601b9d389 for instance 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b on hv-cinder-84617 Jun 16 18:56:26.058907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-358067dc-5523-4076-afad-5636594157e6 req-7f648d20-91bd-42ad-b276-0b82b338590f service nova] Acquired lock "compute-rpcapi-router" {{(pid=130229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:56:26.060838 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2aff2106-3543-4db0-b59c-9527f04a3408 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:26.068918 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2aff2106-3543-4db0-b59c-9527f04a3408 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:26.069865 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2aff2106-3543-4db0-b59c-9527f04a3408 None None] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:26.070318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2aff2106-3543-4db0-b59c-9527f04a3408 None None] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:26.089180 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.compute.rpcapi [None req-2aff2106-3543-4db0-b59c-9527f04a3408 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 18:56:26.090833 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2aff2106-3543-4db0-b59c-9527f04a3408 None None] Releasing lock "compute-rpcapi-router" {{(pid=130229) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:56:26.129105 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-2aff2106-3543-4db0-b59c-9527f04a3408 None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149859 Jun 16 18:56:26.130241 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 22/42] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:56:26.135551 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-2047b118-7d1a-4537-bab2-db89597c45da tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:26.137293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-2047b118-7d1a-4537-bab2-db89597c45da tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:26.160846 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2047b118-7d1a-4537-bab2-db89597c45da tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:26.161800 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2047b118-7d1a-4537-bab2-db89597c45da tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:26.163063 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2047b118-7d1a-4537-bab2-db89597c45da tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:26.163695 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2047b118-7d1a-4537-bab2-db89597c45da tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:26.663240 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-2047b118-7d1a-4537-bab2-db89597c45da tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:26.676427 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-2047b118-7d1a-4537-bab2-db89597c45da tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.543582 Jun 16 18:56:26.679436 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 23/43] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:26 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:26.693230 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9a1bc461-13cd-44e5-9082-a6e08fbdc720 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:26.697202 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9a1bc461-13cd-44e5-9082-a6e08fbdc720 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:26.708702 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9a1bc461-13cd-44e5-9082-a6e08fbdc720 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:26.709446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9a1bc461-13cd-44e5-9082-a6e08fbdc720 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:26.711147 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9a1bc461-13cd-44e5-9082-a6e08fbdc720 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:26.713940 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9a1bc461-13cd-44e5-9082-a6e08fbdc720 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:26.723224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-43f187e5-92d0-4ceb-8c20-3167090fe69d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:26.734014 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-43f187e5-92d0-4ceb-8c20-3167090fe69d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.882284 Jun 16 18:56:26.734597 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 21/44] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:25 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:26.995179 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9a1bc461-13cd-44e5-9082-a6e08fbdc720 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:26.995392 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-204f073a-c13b-4733-b79e-06b9c209dbc7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:26.995904 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-204f073a-c13b-4733-b79e-06b9c209dbc7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:27.006228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-204f073a-c13b-4733-b79e-06b9c209dbc7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:27.006681 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-204f073a-c13b-4733-b79e-06b9c209dbc7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:27.007459 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-204f073a-c13b-4733-b79e-06b9c209dbc7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:27.007893 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-204f073a-c13b-4733-b79e-06b9c209dbc7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:27.014329 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9a1bc461-13cd-44e5-9082-a6e08fbdc720 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:27.018694 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9a1bc461-13cd-44e5-9082-a6e08fbdc720 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:27.024396 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9a1bc461-13cd-44e5-9082-a6e08fbdc720 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1338 microversion: 2.20 time: 0.340230 Jun 16 18:56:27.025226 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 24/45] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:26 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1338 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:27.700354 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=28 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:27.866367 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-204f073a-c13b-4733-b79e-06b9c209dbc7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:27.881707 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-204f073a-c13b-4733-b79e-06b9c209dbc7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.886317 Jun 16 18:56:27.882585 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 22/46] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:26 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:27.893721 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c2df43ee-1d95-4822-a9ad-7c4342e831de tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:27.896228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-c2df43ee-1d95-4822-a9ad-7c4342e831de tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:27.909267 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c2df43ee-1d95-4822-a9ad-7c4342e831de tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:27.914638 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c2df43ee-1d95-4822-a9ad-7c4342e831de tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:27.914638 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c2df43ee-1d95-4822-a9ad-7c4342e831de tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:27.914638 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c2df43ee-1d95-4822-a9ad-7c4342e831de tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:28.093070 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-c0296c06-ea30-4206-bd2b-614f9764f0a4 req-9fd0999c-230e-487a-a0ee-775a6d7fe5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bad769d-1b62-4d0f-8491-bfae3997a525", "tag": "813e5e92-6255-46b0-aa69-1964caa13cf4"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:28.110934 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:28.129669 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-c0296c06-ea30-4206-bd2b-614f9764f0a4 req-9fd0999c-230e-487a-a0ee-775a6d7fe5e7 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:28.132932 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-c0296c06-ea30-4206-bd2b-614f9764f0a4 req-9fd0999c-230e-487a-a0ee-775a6d7fe5e7 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:28.177147 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-c0296c06-ea30-4206-bd2b-614f9764f0a4 req-9fd0999c-230e-487a-a0ee-775a6d7fe5e7 service nova] Creating event network-changed:813e5e92-6255-46b0-aa69-1964caa13cf4 for instance 8bad769d-1b62-4d0f-8491-bfae3997a525 on hv-cinder-84617 Jun 16 18:56:28.183599 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-c0296c06-ea30-4206-bd2b-614f9764f0a4 req-9fd0999c-230e-487a-a0ee-775a6d7fe5e7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.679751 Jun 16 18:56:28.193158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 25/47] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:56:28.200398 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-684704f4-557b-499f-a253-8868a0788736 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:28.220088 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-684704f4-557b-499f-a253-8868a0788736 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:28.238054 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-684704f4-557b-499f-a253-8868a0788736 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:28.239263 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-684704f4-557b-499f-a253-8868a0788736 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:28.240873 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-684704f4-557b-499f-a253-8868a0788736 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:28.242172 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-684704f4-557b-499f-a253-8868a0788736 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:28.958438 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c2df43ee-1d95-4822-a9ad-7c4342e831de tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:28.960831 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-684704f4-557b-499f-a253-8868a0788736 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:28.966536 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=100 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:28.968976 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=100 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:28.970669 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-c2df43ee-1d95-4822-a9ad-7c4342e831de tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 1.086360 Jun 16 18:56:28.973536 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-684704f4-557b-499f-a253-8868a0788736 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.777342 Jun 16 18:56:28.976565 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 26/48] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:28 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:28.983461 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 23/49] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:27 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:28.990659 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-786a5e06-1f2b-42ad-852e-b6d37613115a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:28.991774 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-786a5e06-1f2b-42ad-852e-b6d37613115a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:28.994222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4693a824-c032-4547-bab4-da738a1ba853 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:28.996082 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4693a824-c032-4547-bab4-da738a1ba853 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:29.003803 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-786a5e06-1f2b-42ad-852e-b6d37613115a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:29.004488 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-786a5e06-1f2b-42ad-852e-b6d37613115a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:29.006303 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-786a5e06-1f2b-42ad-852e-b6d37613115a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:29.006909 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-786a5e06-1f2b-42ad-852e-b6d37613115a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:29.014459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4693a824-c032-4547-bab4-da738a1ba853 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:29.018028 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4693a824-c032-4547-bab4-da738a1ba853 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:29.021710 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4693a824-c032-4547-bab4-da738a1ba853 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:29.023601 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4693a824-c032-4547-bab4-da738a1ba853 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:29.525971 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4693a824-c032-4547-bab4-da738a1ba853 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:29.535487 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4693a824-c032-4547-bab4-da738a1ba853 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:29.544710 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4693a824-c032-4547-bab4-da738a1ba853 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:29.546579 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4693a824-c032-4547-bab4-da738a1ba853 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.570495 Jun 16 18:56:29.553346 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 27/50] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:28 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:29.624089 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-786a5e06-1f2b-42ad-852e-b6d37613115a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:29.650252 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-786a5e06-1f2b-42ad-852e-b6d37613115a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.663136 Jun 16 18:56:29.651950 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 24/51] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:28 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:29.990970 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-0ea3deba-4d5b-4f39-a116-77f49df215eb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:29.992062 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-0ea3deba-4d5b-4f39-a116-77f49df215eb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:29.995985 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-79b0819e-9bf7-4f1c-8d94-7f49066de48b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:29.996605 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-79b0819e-9bf7-4f1c-8d94-7f49066de48b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:30.008881 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-79b0819e-9bf7-4f1c-8d94-7f49066de48b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:30.019209 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0ea3deba-4d5b-4f39-a116-77f49df215eb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:30.020094 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-79b0819e-9bf7-4f1c-8d94-7f49066de48b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:30.021086 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-79b0819e-9bf7-4f1c-8d94-7f49066de48b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:30.025900 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0ea3deba-4d5b-4f39-a116-77f49df215eb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:30.026764 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-79b0819e-9bf7-4f1c-8d94-7f49066de48b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:30.027790 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0ea3deba-4d5b-4f39-a116-77f49df215eb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:30.029818 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0ea3deba-4d5b-4f39-a116-77f49df215eb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:30.717946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-0ea3deba-4d5b-4f39-a116-77f49df215eb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:30.724497 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-79b0819e-9bf7-4f1c-8d94-7f49066de48b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:30.730881 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-0ea3deba-4d5b-4f39-a116-77f49df215eb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.740266 Jun 16 18:56:30.737621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-79b0819e-9bf7-4f1c-8d94-7f49066de48b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.752964 Jun 16 18:56:30.739329 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 28/52] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:29 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:30.742944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 25/53] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:29 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:30.766084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-73325404-ffde-47d8-b662-4220cc4770eb req-a52eee32-2008-4c7f-af20-36bc4fa1a750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410bdd70-d5fd-4cfe-ad04-cf135bef00ff", "tag": "874e17b1-59b4-455e-93ae-78a55fa69aa1"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:30.767527 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9ac85096-d063-434b-aae7-f762090562a1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:30.770373 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9ac85096-d063-434b-aae7-f762090562a1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:30.791423 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9ac85096-d063-434b-aae7-f762090562a1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:30.792191 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9ac85096-d063-434b-aae7-f762090562a1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:30.796324 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9ac85096-d063-434b-aae7-f762090562a1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:30.796659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-73325404-ffde-47d8-b662-4220cc4770eb req-a52eee32-2008-4c7f-af20-36bc4fa1a750 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:30.797266 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-73325404-ffde-47d8-b662-4220cc4770eb req-a52eee32-2008-4c7f-af20-36bc4fa1a750 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:30.801483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9ac85096-d063-434b-aae7-f762090562a1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:30.838287 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-73325404-ffde-47d8-b662-4220cc4770eb req-a52eee32-2008-4c7f-af20-36bc4fa1a750 service nova] Creating event network-changed:874e17b1-59b4-455e-93ae-78a55fa69aa1 for instance 410bdd70-d5fd-4cfe-ad04-cf135bef00ff on hv-cinder-84617 Jun 16 18:56:30.851303 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-73325404-ffde-47d8-b662-4220cc4770eb req-a52eee32-2008-4c7f-af20-36bc4fa1a750 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110013 Jun 16 18:56:30.878239 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 29/54] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:56:30.884184 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a6edefb9-67c5-4aca-a1fc-63a134f90943 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:30.885177 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a6edefb9-67c5-4aca-a1fc-63a134f90943 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:30.896846 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a6edefb9-67c5-4aca-a1fc-63a134f90943 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:30.897495 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a6edefb9-67c5-4aca-a1fc-63a134f90943 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:30.898491 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a6edefb9-67c5-4aca-a1fc-63a134f90943 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:30.899019 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a6edefb9-67c5-4aca-a1fc-63a134f90943 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:31.459911 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9ac85096-d063-434b-aae7-f762090562a1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:31.472400 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9ac85096-d063-434b-aae7-f762090562a1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:31.474760 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9ac85096-d063-434b-aae7-f762090562a1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:31.476436 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9ac85096-d063-434b-aae7-f762090562a1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.733549 Jun 16 18:56:31.477758 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 26/55] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:30 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:31.604050 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a6edefb9-67c5-4aca-a1fc-63a134f90943 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:31.613596 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a6edefb9-67c5-4aca-a1fc-63a134f90943 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.738338 Jun 16 18:56:31.614172 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 30/56] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:30 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:31.750980 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-8d5fa060-7ac0-4d21-9a6e-07fea08cb19d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:31.751747 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-8d5fa060-7ac0-4d21-9a6e-07fea08cb19d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:31.758291 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8d5fa060-7ac0-4d21-9a6e-07fea08cb19d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:31.760749 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8d5fa060-7ac0-4d21-9a6e-07fea08cb19d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:31.760865 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-04a15445-98c3-4468-b453-3bac1d632d0e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:31.760973 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8d5fa060-7ac0-4d21-9a6e-07fea08cb19d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:31.760973 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8d5fa060-7ac0-4d21-9a6e-07fea08cb19d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:31.761136 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-04a15445-98c3-4468-b453-3bac1d632d0e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:31.768514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-04a15445-98c3-4468-b453-3bac1d632d0e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:31.770468 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-04a15445-98c3-4468-b453-3bac1d632d0e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:31.772822 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-04a15445-98c3-4468-b453-3bac1d632d0e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:31.774327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-04a15445-98c3-4468-b453-3bac1d632d0e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:31.992414 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8d5fa060-7ac0-4d21-9a6e-07fea08cb19d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:32.003116 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-8d5fa060-7ac0-4d21-9a6e-07fea08cb19d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.255980 Jun 16 18:56:32.003865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 27/57] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:31 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:32.004711 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-04a15445-98c3-4468-b453-3bac1d632d0e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:32.012387 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-04a15445-98c3-4468-b453-3bac1d632d0e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.256990 Jun 16 18:56:32.012949 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 31/58] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:31 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:32.494838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-24b79cec-c1e1-4f16-ba29-76508cd993a4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:32.495453 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-24b79cec-c1e1-4f16-ba29-76508cd993a4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:32.501517 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-24b79cec-c1e1-4f16-ba29-76508cd993a4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:32.501970 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-24b79cec-c1e1-4f16-ba29-76508cd993a4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:32.502742 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-24b79cec-c1e1-4f16-ba29-76508cd993a4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:32.503183 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-24b79cec-c1e1-4f16-ba29-76508cd993a4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:32.629933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7621c887-c748-41d0-bd06-fb370ff193fe tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:32.639474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7621c887-c748-41d0-bd06-fb370ff193fe tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:32.639474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7621c887-c748-41d0-bd06-fb370ff193fe tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:32.640180 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7621c887-c748-41d0-bd06-fb370ff193fe tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:32.640986 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7621c887-c748-41d0-bd06-fb370ff193fe tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:32.641524 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7621c887-c748-41d0-bd06-fb370ff193fe tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:32.650030 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-24b79cec-c1e1-4f16-ba29-76508cd993a4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:32.658630 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-24b79cec-c1e1-4f16-ba29-76508cd993a4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:32.660159 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-24b79cec-c1e1-4f16-ba29-76508cd993a4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:32.661405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-24b79cec-c1e1-4f16-ba29-76508cd993a4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.170451 Jun 16 18:56:32.668167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 28/59] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:32 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:32.777600 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7621c887-c748-41d0-bd06-fb370ff193fe tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:32.786121 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7621c887-c748-41d0-bd06-fb370ff193fe tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.160413 Jun 16 18:56:32.786881 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 32/60] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:32 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:32.868048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-9bfa65cc-0365-4f9d-9cc2-a661b4a35043 req-4057d554-8813-430d-a83d-cd673c48c31c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c04798-b061-421b-9b61-db9cce7dace4", "tag": "44fe652d-5231-4810-99fa-21c58c429e9c"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:32.877050 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-9bfa65cc-0365-4f9d-9cc2-a661b4a35043 req-4057d554-8813-430d-a83d-cd673c48c31c service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:32.877521 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-9bfa65cc-0365-4f9d-9cc2-a661b4a35043 req-4057d554-8813-430d-a83d-cd673c48c31c service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:32.888069 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-9bfa65cc-0365-4f9d-9cc2-a661b4a35043 req-4057d554-8813-430d-a83d-cd673c48c31c service nova] Creating event network-changed:44fe652d-5231-4810-99fa-21c58c429e9c for instance d6c04798-b061-421b-9b61-db9cce7dace4 on hv-cinder-84617 Jun 16 18:56:32.892919 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-9bfa65cc-0365-4f9d-9cc2-a661b4a35043 req-4057d554-8813-430d-a83d-cd673c48c31c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028823 Jun 16 18:56:32.893539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 29/61] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:56:33.020740 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4caa38b3-8c2a-49a6-a025-7a1327131910 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:33.020740 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4caa38b3-8c2a-49a6-a025-7a1327131910 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:33.027436 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4caa38b3-8c2a-49a6-a025-7a1327131910 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:33.028106 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4caa38b3-8c2a-49a6-a025-7a1327131910 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:33.029131 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4caa38b3-8c2a-49a6-a025-7a1327131910 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:33.030144 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4caa38b3-8c2a-49a6-a025-7a1327131910 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:33.031469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-eb22b8fa-afb7-4341-a24a-17cbf3051236 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:33.032396 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-eb22b8fa-afb7-4341-a24a-17cbf3051236 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:33.039140 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-eb22b8fa-afb7-4341-a24a-17cbf3051236 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:33.039589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-eb22b8fa-afb7-4341-a24a-17cbf3051236 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:33.043126 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-eb22b8fa-afb7-4341-a24a-17cbf3051236 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:33.043126 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-eb22b8fa-afb7-4341-a24a-17cbf3051236 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:33.228004 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4caa38b3-8c2a-49a6-a025-7a1327131910 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:33.232559 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-eb22b8fa-afb7-4341-a24a-17cbf3051236 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:33.236615 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4caa38b3-8c2a-49a6-a025-7a1327131910 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.220219 Jun 16 18:56:33.242249 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 33/62] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:33 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:33.242360 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-eb22b8fa-afb7-4341-a24a-17cbf3051236 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.214697 Jun 16 18:56:33.242360 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 30/63] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:33 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:33.686390 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9810b1b2-fec4-40db-841e-e210e3546af9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:33.686390 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9810b1b2-fec4-40db-841e-e210e3546af9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:33.703003 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9810b1b2-fec4-40db-841e-e210e3546af9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:33.703003 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9810b1b2-fec4-40db-841e-e210e3546af9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:33.707015 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9810b1b2-fec4-40db-841e-e210e3546af9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:33.707015 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9810b1b2-fec4-40db-841e-e210e3546af9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:33.803337 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-0e9f6b5e-a9b8-418f-86f9-d356e90a947e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:33.804523 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-0e9f6b5e-a9b8-418f-86f9-d356e90a947e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:33.811891 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0e9f6b5e-a9b8-418f-86f9-d356e90a947e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:33.812557 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0e9f6b5e-a9b8-418f-86f9-d356e90a947e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:33.813501 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0e9f6b5e-a9b8-418f-86f9-d356e90a947e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:33.814080 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0e9f6b5e-a9b8-418f-86f9-d356e90a947e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:33.818942 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=8 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:33.855054 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9810b1b2-fec4-40db-841e-e210e3546af9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:33.863335 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9810b1b2-fec4-40db-841e-e210e3546af9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:33.864866 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9810b1b2-fec4-40db-841e-e210e3546af9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:33.866181 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9810b1b2-fec4-40db-841e-e210e3546af9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.185900 Jun 16 18:56:33.876956 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 34/64] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:33 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:56:33.947973 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-0e9f6b5e-a9b8-418f-86f9-d356e90a947e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:33.956116 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-0e9f6b5e-a9b8-418f-86f9-d356e90a947e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.156747 Jun 16 18:56:33.956816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 31/65] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:33 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:34.254162 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4bde7a96-17d9-4d01-82d1-16065bba7d29 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:34.254951 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4bde7a96-17d9-4d01-82d1-16065bba7d29 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:34.256241 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b607ee30-7f94-483b-9805-f8b5019e4465 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:34.256863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b607ee30-7f94-483b-9805-f8b5019e4465 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:34.261390 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4bde7a96-17d9-4d01-82d1-16065bba7d29 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:34.261849 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4bde7a96-17d9-4d01-82d1-16065bba7d29 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:34.262660 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4bde7a96-17d9-4d01-82d1-16065bba7d29 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:34.263101 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4bde7a96-17d9-4d01-82d1-16065bba7d29 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:34.263607 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b607ee30-7f94-483b-9805-f8b5019e4465 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:34.264280 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b607ee30-7f94-483b-9805-f8b5019e4465 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:34.265206 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b607ee30-7f94-483b-9805-f8b5019e4465 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:34.265820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b607ee30-7f94-483b-9805-f8b5019e4465 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:34.470868 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b607ee30-7f94-483b-9805-f8b5019e4465 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:34.479122 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b607ee30-7f94-483b-9805-f8b5019e4465 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.226569 Jun 16 18:56:34.480179 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 32/66] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:34 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:34.486508 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4bde7a96-17d9-4d01-82d1-16065bba7d29 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:34.495002 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4bde7a96-17d9-4d01-82d1-16065bba7d29 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.244672 Jun 16 18:56:34.495714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 35/67] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:34 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:34.884177 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2fc2213d-2e01-48c2-9209-bf1d0355fa90 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:34.884800 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2fc2213d-2e01-48c2-9209-bf1d0355fa90 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:34.891744 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2fc2213d-2e01-48c2-9209-bf1d0355fa90 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:34.892204 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2fc2213d-2e01-48c2-9209-bf1d0355fa90 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:34.892978 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2fc2213d-2e01-48c2-9209-bf1d0355fa90 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:34.893537 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2fc2213d-2e01-48c2-9209-bf1d0355fa90 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:34.973917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-621fad24-5c05-462a-8965-ba8ee0b4bdff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:34.974537 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-621fad24-5c05-462a-8965-ba8ee0b4bdff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:34.984778 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-621fad24-5c05-462a-8965-ba8ee0b4bdff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:34.985469 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-621fad24-5c05-462a-8965-ba8ee0b4bdff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:34.986527 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-621fad24-5c05-462a-8965-ba8ee0b4bdff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:34.986926 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-621fad24-5c05-462a-8965-ba8ee0b4bdff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:35.133151 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2fc2213d-2e01-48c2-9209-bf1d0355fa90 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:35.142392 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2fc2213d-2e01-48c2-9209-bf1d0355fa90 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:35.143953 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2fc2213d-2e01-48c2-9209-bf1d0355fa90 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:35.145080 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2fc2213d-2e01-48c2-9209-bf1d0355fa90 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.264948 Jun 16 18:56:35.156436 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 33/68] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:34 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:35.179898 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-621fad24-5c05-462a-8965-ba8ee0b4bdff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:35.188716 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-621fad24-5c05-462a-8965-ba8ee0b4bdff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.218592 Jun 16 18:56:35.189316 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 36/69] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:34 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:35.500387 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4cd59030-3d5d-45df-8ee4-b3964e8d69f5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:35.501365 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4cd59030-3d5d-45df-8ee4-b3964e8d69f5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:35.514914 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-176b62d5-fb71-4d8a-8c92-d9531e5854d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:35.516135 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-176b62d5-fb71-4d8a-8c92-d9531e5854d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:35.531537 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4cd59030-3d5d-45df-8ee4-b3964e8d69f5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:35.533084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-176b62d5-fb71-4d8a-8c92-d9531e5854d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:35.533783 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4cd59030-3d5d-45df-8ee4-b3964e8d69f5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:35.535445 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4cd59030-3d5d-45df-8ee4-b3964e8d69f5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:35.536098 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-176b62d5-fb71-4d8a-8c92-d9531e5854d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:35.537556 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-176b62d5-fb71-4d8a-8c92-d9531e5854d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:35.538226 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4cd59030-3d5d-45df-8ee4-b3964e8d69f5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:35.540589 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-176b62d5-fb71-4d8a-8c92-d9531e5854d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:35.996904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-176b62d5-fb71-4d8a-8c92-d9531e5854d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:36.000527 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4cd59030-3d5d-45df-8ee4-b3964e8d69f5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:36.006796 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-176b62d5-fb71-4d8a-8c92-d9531e5854d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.498526 Jun 16 18:56:36.011324 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 37/70] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:35 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:36.011485 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4cd59030-3d5d-45df-8ee4-b3964e8d69f5 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.518506 Jun 16 18:56:36.011485 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 34/71] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:35 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:36.160918 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:36.165437 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1805ffae-393b-436b-b24c-f2f300b1f2fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:36.170964 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-1805ffae-393b-436b-b24c-f2f300b1f2fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:36.189410 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1805ffae-393b-436b-b24c-f2f300b1f2fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:36.190233 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1805ffae-393b-436b-b24c-f2f300b1f2fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:36.191239 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1805ffae-393b-436b-b24c-f2f300b1f2fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:36.191964 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1805ffae-393b-436b-b24c-f2f300b1f2fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:36.205835 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a4c559e0-1782-451f-97d1-e785c16a1947 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:36.206538 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a4c559e0-1782-451f-97d1-e785c16a1947 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:36.212920 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a4c559e0-1782-451f-97d1-e785c16a1947 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:36.213675 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a4c559e0-1782-451f-97d1-e785c16a1947 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:36.214556 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a4c559e0-1782-451f-97d1-e785c16a1947 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:36.215295 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a4c559e0-1782-451f-97d1-e785c16a1947 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:36.455165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1805ffae-393b-436b-b24c-f2f300b1f2fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:36.463560 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1805ffae-393b-436b-b24c-f2f300b1f2fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:36.465078 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1805ffae-393b-436b-b24c-f2f300b1f2fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:36.466606 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-1805ffae-393b-436b-b24c-f2f300b1f2fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.306541 Jun 16 18:56:36.467437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a4c559e0-1782-451f-97d1-e785c16a1947 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:36.476374 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a4c559e0-1782-451f-97d1-e785c16a1947 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.274801 Jun 16 18:56:36.477140 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 35/72] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:36 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:36.477357 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 38/73] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:36 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:37.023752 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4c9c7cba-cb8e-47e2-bf43-6cc988cfe71d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:37.024405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4c9c7cba-cb8e-47e2-bf43-6cc988cfe71d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:37.026560 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f2e2e8c1-b00d-4d3c-bccf-d17021baf726 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:37.027178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f2e2e8c1-b00d-4d3c-bccf-d17021baf726 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:37.030726 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c9c7cba-cb8e-47e2-bf43-6cc988cfe71d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:37.031189 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c9c7cba-cb8e-47e2-bf43-6cc988cfe71d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:37.032827 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c9c7cba-cb8e-47e2-bf43-6cc988cfe71d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:37.032827 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c9c7cba-cb8e-47e2-bf43-6cc988cfe71d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:37.042188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f2e2e8c1-b00d-4d3c-bccf-d17021baf726 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:37.042614 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f2e2e8c1-b00d-4d3c-bccf-d17021baf726 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:37.043385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f2e2e8c1-b00d-4d3c-bccf-d17021baf726 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:37.043822 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f2e2e8c1-b00d-4d3c-bccf-d17021baf726 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:37.241968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4c9c7cba-cb8e-47e2-bf43-6cc988cfe71d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:37.244432 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f2e2e8c1-b00d-4d3c-bccf-d17021baf726 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:37.253749 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f2e2e8c1-b00d-4d3c-bccf-d17021baf726 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.230809 Jun 16 18:56:37.300725 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 39/74] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:37 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:37.301640 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4c9c7cba-cb8e-47e2-bf43-6cc988cfe71d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.237264 Jun 16 18:56:37.301640 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 36/75] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:37 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:37.489649 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-09104939-5e51-4ac2-be95-3a0d2c318abb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:37.490434 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-09104939-5e51-4ac2-be95-3a0d2c318abb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:37.493455 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-07fcdc20-4cba-45f5-9796-1f41cfb462d0 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:37.494035 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-07fcdc20-4cba-45f5-9796-1f41cfb462d0 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:37.496492 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-09104939-5e51-4ac2-be95-3a0d2c318abb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:37.496946 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-09104939-5e51-4ac2-be95-3a0d2c318abb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:37.497746 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-09104939-5e51-4ac2-be95-3a0d2c318abb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:37.498733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-09104939-5e51-4ac2-be95-3a0d2c318abb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:37.502882 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-07fcdc20-4cba-45f5-9796-1f41cfb462d0 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:37.503334 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-07fcdc20-4cba-45f5-9796-1f41cfb462d0 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:37.504096 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-07fcdc20-4cba-45f5-9796-1f41cfb462d0 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:37.504528 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-07fcdc20-4cba-45f5-9796-1f41cfb462d0 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:37.705923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-09104939-5e51-4ac2-be95-3a0d2c318abb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:37.709680 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-07fcdc20-4cba-45f5-9796-1f41cfb462d0 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:37.715209 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-09104939-5e51-4ac2-be95-3a0d2c318abb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:37.717824 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-09104939-5e51-4ac2-be95-3a0d2c318abb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:37.719361 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-09104939-5e51-4ac2-be95-3a0d2c318abb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.233713 Jun 16 18:56:37.719849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-07fcdc20-4cba-45f5-9796-1f41cfb462d0 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.230438 Jun 16 18:56:37.721083 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 37/76] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:37 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:37.729425 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 40/77] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:37 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:38.271310 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-010577c5-a30d-4b11-947e-266985526aaa tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:38.272044 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-010577c5-a30d-4b11-947e-266985526aaa tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:38.273723 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7ea3d5fb-d9e5-4385-b8d0-e1eb5e71e6a0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:38.274358 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7ea3d5fb-d9e5-4385-b8d0-e1eb5e71e6a0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:38.278331 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-010577c5-a30d-4b11-947e-266985526aaa tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:38.284015 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-010577c5-a30d-4b11-947e-266985526aaa tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:38.284015 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-010577c5-a30d-4b11-947e-266985526aaa tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:38.284015 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-010577c5-a30d-4b11-947e-266985526aaa tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:38.284313 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7ea3d5fb-d9e5-4385-b8d0-e1eb5e71e6a0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:38.284313 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7ea3d5fb-d9e5-4385-b8d0-e1eb5e71e6a0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:38.284313 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7ea3d5fb-d9e5-4385-b8d0-e1eb5e71e6a0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:38.284313 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7ea3d5fb-d9e5-4385-b8d0-e1eb5e71e6a0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:38.467112 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7ea3d5fb-d9e5-4385-b8d0-e1eb5e71e6a0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:38.475738 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7ea3d5fb-d9e5-4385-b8d0-e1eb5e71e6a0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.206005 Jun 16 18:56:38.476314 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 41/78] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:38 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:38.492990 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-010577c5-a30d-4b11-947e-266985526aaa tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:38.501014 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-010577c5-a30d-4b11-947e-266985526aaa tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.234039 Jun 16 18:56:38.501518 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 38/79] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:38 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:38.736568 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-cfb65301-acae-4dc9-86d9-960b6575a728 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:38.737290 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-cfb65301-acae-4dc9-86d9-960b6575a728 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:38.742649 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-04db357e-26eb-4d7e-83fe-51f540f2cdcf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:38.743275 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-04db357e-26eb-4d7e-83fe-51f540f2cdcf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:38.743664 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cfb65301-acae-4dc9-86d9-960b6575a728 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:38.744184 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cfb65301-acae-4dc9-86d9-960b6575a728 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:38.745343 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cfb65301-acae-4dc9-86d9-960b6575a728 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:38.746164 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cfb65301-acae-4dc9-86d9-960b6575a728 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:38.749880 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-04db357e-26eb-4d7e-83fe-51f540f2cdcf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:38.750359 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-04db357e-26eb-4d7e-83fe-51f540f2cdcf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:38.751355 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-04db357e-26eb-4d7e-83fe-51f540f2cdcf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:38.751799 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-04db357e-26eb-4d7e-83fe-51f540f2cdcf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:38.954593 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-04db357e-26eb-4d7e-83fe-51f540f2cdcf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:38.957218 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cfb65301-acae-4dc9-86d9-960b6575a728 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:38.963743 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-04db357e-26eb-4d7e-83fe-51f540f2cdcf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:38.965486 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-04db357e-26eb-4d7e-83fe-51f540f2cdcf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:38.966634 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-04db357e-26eb-4d7e-83fe-51f540f2cdcf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.228578 Jun 16 18:56:38.966921 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-cfb65301-acae-4dc9-86d9-960b6575a728 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.234700 Jun 16 18:56:38.967812 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 39/80] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:38 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:56:38.968271 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 42/81] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:38 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:39.492820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-29373f8b-2c64-4944-9403-4a03ce2349fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:39.493476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-29373f8b-2c64-4944-9403-4a03ce2349fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:39.499964 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29373f8b-2c64-4944-9403-4a03ce2349fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:39.500416 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29373f8b-2c64-4944-9403-4a03ce2349fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:39.501221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29373f8b-2c64-4944-9403-4a03ce2349fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:39.501652 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29373f8b-2c64-4944-9403-4a03ce2349fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:39.518056 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a7324264-4bdb-482f-bd74-bc3b346386bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:39.518681 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a7324264-4bdb-482f-bd74-bc3b346386bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:39.524668 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a7324264-4bdb-482f-bd74-bc3b346386bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:39.525121 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a7324264-4bdb-482f-bd74-bc3b346386bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:39.525922 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a7324264-4bdb-482f-bd74-bc3b346386bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:39.526361 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a7324264-4bdb-482f-bd74-bc3b346386bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:39.699522 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-29373f8b-2c64-4944-9403-4a03ce2349fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:39.708382 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-29373f8b-2c64-4944-9403-4a03ce2349fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.219364 Jun 16 18:56:39.708862 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a7324264-4bdb-482f-bd74-bc3b346386bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:39.709287 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 40/82] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:39 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:39.717491 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a7324264-4bdb-482f-bd74-bc3b346386bf tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.202704 Jun 16 18:56:39.718362 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 43/83] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:39 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:39.984283 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-64bdb3d0-b223-463b-a007-35a3d90aa2bd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:39.984878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ff9e8e5e-259e-4ce7-a0fc-1ecc79ed42da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:39.985025 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-64bdb3d0-b223-463b-a007-35a3d90aa2bd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:39.985550 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ff9e8e5e-259e-4ce7-a0fc-1ecc79ed42da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:39.990877 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-64bdb3d0-b223-463b-a007-35a3d90aa2bd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:39.991310 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-64bdb3d0-b223-463b-a007-35a3d90aa2bd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:39.991536 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff9e8e5e-259e-4ce7-a0fc-1ecc79ed42da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:39.992037 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff9e8e5e-259e-4ce7-a0fc-1ecc79ed42da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:39.992186 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-64bdb3d0-b223-463b-a007-35a3d90aa2bd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:39.992502 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-64bdb3d0-b223-463b-a007-35a3d90aa2bd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:39.992803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff9e8e5e-259e-4ce7-a0fc-1ecc79ed42da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:39.993259 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff9e8e5e-259e-4ce7-a0fc-1ecc79ed42da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:39.996465 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=100 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:39.997584 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=100 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:40.197664 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ff9e8e5e-259e-4ce7-a0fc-1ecc79ed42da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:40.205901 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-64bdb3d0-b223-463b-a007-35a3d90aa2bd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:40.207012 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ff9e8e5e-259e-4ce7-a0fc-1ecc79ed42da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:40.208759 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ff9e8e5e-259e-4ce7-a0fc-1ecc79ed42da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:40.210136 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ff9e8e5e-259e-4ce7-a0fc-1ecc79ed42da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.229356 Jun 16 18:56:40.217268 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 44/84] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:39 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:40.218446 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-64bdb3d0-b223-463b-a007-35a3d90aa2bd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.234940 Jun 16 18:56:40.218446 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 41/85] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:39 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:40.725536 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-835ddd15-b6e6-4f45-a56a-9ad00f4724b4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:40.726150 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-835ddd15-b6e6-4f45-a56a-9ad00f4724b4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:40.733069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-835ddd15-b6e6-4f45-a56a-9ad00f4724b4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:40.733537 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-835ddd15-b6e6-4f45-a56a-9ad00f4724b4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:40.734440 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-82c10f49-d853-4e95-bd48-4e049271f1b9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:40.734896 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-835ddd15-b6e6-4f45-a56a-9ad00f4724b4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:40.734896 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-835ddd15-b6e6-4f45-a56a-9ad00f4724b4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:40.735269 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-82c10f49-d853-4e95-bd48-4e049271f1b9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:40.741481 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-82c10f49-d853-4e95-bd48-4e049271f1b9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:40.745778 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-82c10f49-d853-4e95-bd48-4e049271f1b9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:40.745778 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-82c10f49-d853-4e95-bd48-4e049271f1b9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:40.745778 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-82c10f49-d853-4e95-bd48-4e049271f1b9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:40.928924 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-835ddd15-b6e6-4f45-a56a-9ad00f4724b4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:40.932581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-82c10f49-d853-4e95-bd48-4e049271f1b9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:40.936803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-835ddd15-b6e6-4f45-a56a-9ad00f4724b4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.215171 Jun 16 18:56:40.940933 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-82c10f49-d853-4e95-bd48-4e049271f1b9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.211380 Jun 16 18:56:40.942967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 42/86] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:40 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:40.943075 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 45/87] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:40 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:41.235858 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4d3aeca1-6a0b-4a1b-ae4f-74a2beb971ab tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:41.236471 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4d3aeca1-6a0b-4a1b-ae4f-74a2beb971ab tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:41.240325 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9395ebf6-1304-4021-a0ca-98521a22d29a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:41.240934 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9395ebf6-1304-4021-a0ca-98521a22d29a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:41.249360 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9395ebf6-1304-4021-a0ca-98521a22d29a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:41.249807 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9395ebf6-1304-4021-a0ca-98521a22d29a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:41.250576 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9395ebf6-1304-4021-a0ca-98521a22d29a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:41.251004 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9395ebf6-1304-4021-a0ca-98521a22d29a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:41.252250 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d3aeca1-6a0b-4a1b-ae4f-74a2beb971ab tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:41.252792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d3aeca1-6a0b-4a1b-ae4f-74a2beb971ab tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:41.253865 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d3aeca1-6a0b-4a1b-ae4f-74a2beb971ab tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:41.254410 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d3aeca1-6a0b-4a1b-ae4f-74a2beb971ab tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:41.478740 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9395ebf6-1304-4021-a0ca-98521a22d29a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:41.481730 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4d3aeca1-6a0b-4a1b-ae4f-74a2beb971ab tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:41.489082 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9395ebf6-1304-4021-a0ca-98521a22d29a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:41.489966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4d3aeca1-6a0b-4a1b-ae4f-74a2beb971ab tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.258902 Jun 16 18:56:41.490533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 46/88] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:41 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:41.490821 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9395ebf6-1304-4021-a0ca-98521a22d29a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:41.491901 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9395ebf6-1304-4021-a0ca-98521a22d29a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.267557 Jun 16 18:56:41.492457 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 43/89] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:41 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:41.965799 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b7399742-d11d-4504-8818-8110f1b67df2 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:41.966891 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6aa3193b-2f98-45ee-84a2-d4ecab44ef43 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:41.967265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6aa3193b-2f98-45ee-84a2-d4ecab44ef43 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:41.968144 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b7399742-d11d-4504-8818-8110f1b67df2 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:41.974660 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7399742-d11d-4504-8818-8110f1b67df2 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:41.975389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7399742-d11d-4504-8818-8110f1b67df2 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:41.979185 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6aa3193b-2f98-45ee-84a2-d4ecab44ef43 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:41.979185 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6aa3193b-2f98-45ee-84a2-d4ecab44ef43 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:41.980152 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7399742-d11d-4504-8818-8110f1b67df2 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:41.980354 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6aa3193b-2f98-45ee-84a2-d4ecab44ef43 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:41.981074 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6aa3193b-2f98-45ee-84a2-d4ecab44ef43 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:41.982652 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7399742-d11d-4504-8818-8110f1b67df2 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:42.314519 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b7399742-d11d-4504-8818-8110f1b67df2 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:42.316191 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6aa3193b-2f98-45ee-84a2-d4ecab44ef43 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:42.324739 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6aa3193b-2f98-45ee-84a2-d4ecab44ef43 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.362535 Jun 16 18:56:42.325639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 44/90] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:41 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:42.327975 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b7399742-d11d-4504-8818-8110f1b67df2 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.364020 Jun 16 18:56:42.337396 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 47/91] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:41 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:42.507739 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-876ce4d7-6e23-4f00-be99-079eb773a0ff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:42.512562 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-876ce4d7-6e23-4f00-be99-079eb773a0ff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:42.512640 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f5187e33-55e5-4e29-8a0b-23f4760ca6ea tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:42.512640 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f5187e33-55e5-4e29-8a0b-23f4760ca6ea tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:42.517599 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-876ce4d7-6e23-4f00-be99-079eb773a0ff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:42.518273 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-876ce4d7-6e23-4f00-be99-079eb773a0ff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:42.519637 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-876ce4d7-6e23-4f00-be99-079eb773a0ff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:42.519832 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f5187e33-55e5-4e29-8a0b-23f4760ca6ea tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:42.520640 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-876ce4d7-6e23-4f00-be99-079eb773a0ff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:42.520812 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f5187e33-55e5-4e29-8a0b-23f4760ca6ea tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:42.521641 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f5187e33-55e5-4e29-8a0b-23f4760ca6ea tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:42.522421 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f5187e33-55e5-4e29-8a0b-23f4760ca6ea tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:42.911526 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-876ce4d7-6e23-4f00-be99-079eb773a0ff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:42.922368 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-876ce4d7-6e23-4f00-be99-079eb773a0ff tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.419005 Jun 16 18:56:42.923170 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f5187e33-55e5-4e29-8a0b-23f4760ca6ea tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:42.923911 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 45/92] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:42 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:42.935162 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f5187e33-55e5-4e29-8a0b-23f4760ca6ea tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:42.940348 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f5187e33-55e5-4e29-8a0b-23f4760ca6ea tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:42.941165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f5187e33-55e5-4e29-8a0b-23f4760ca6ea tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.436149 Jun 16 18:56:42.941765 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 48/93] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:42 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:56:43.344421 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-87663931-a9b4-412f-9f87-0245a56506a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:43.344866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-87663931-a9b4-412f-9f87-0245a56506a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:43.356463 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-87663931-a9b4-412f-9f87-0245a56506a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:43.357273 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-87663931-a9b4-412f-9f87-0245a56506a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:43.359319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-87663931-a9b4-412f-9f87-0245a56506a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:43.359968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-87663931-a9b4-412f-9f87-0245a56506a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:43.367333 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a94e91da-ebb7-426f-a5c3-778647d16732 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:43.369440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a94e91da-ebb7-426f-a5c3-778647d16732 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:43.379441 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a94e91da-ebb7-426f-a5c3-778647d16732 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:43.379905 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a94e91da-ebb7-426f-a5c3-778647d16732 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:43.384712 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a94e91da-ebb7-426f-a5c3-778647d16732 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:43.384712 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a94e91da-ebb7-426f-a5c3-778647d16732 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:43.594590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a94e91da-ebb7-426f-a5c3-778647d16732 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:43.612136 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a94e91da-ebb7-426f-a5c3-778647d16732 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.256705 Jun 16 18:56:43.613070 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 49/94] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:43 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:43.643868 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-87663931-a9b4-412f-9f87-0245a56506a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:43.652803 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-87663931-a9b4-412f-9f87-0245a56506a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.314359 Jun 16 18:56:43.654739 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 46/95] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:43 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:43.940767 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-409a4073-62e3-45ce-9f92-1a9a9ee1aaa7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:43.941592 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-409a4073-62e3-45ce-9f92-1a9a9ee1aaa7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:43.947737 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-409a4073-62e3-45ce-9f92-1a9a9ee1aaa7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:43.950683 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-409a4073-62e3-45ce-9f92-1a9a9ee1aaa7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:43.950683 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-409a4073-62e3-45ce-9f92-1a9a9ee1aaa7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:43.950683 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-409a4073-62e3-45ce-9f92-1a9a9ee1aaa7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:43.959880 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-37940523-ce04-4b64-ac41-614d04c58f7b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:43.960761 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-37940523-ce04-4b64-ac41-614d04c58f7b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:43.976194 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-37940523-ce04-4b64-ac41-614d04c58f7b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:43.980017 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-37940523-ce04-4b64-ac41-614d04c58f7b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:43.980017 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-37940523-ce04-4b64-ac41-614d04c58f7b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:43.980017 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-37940523-ce04-4b64-ac41-614d04c58f7b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:44.162603 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-409a4073-62e3-45ce-9f92-1a9a9ee1aaa7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:44.176273 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-409a4073-62e3-45ce-9f92-1a9a9ee1aaa7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.239420 Jun 16 18:56:44.181326 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 50/96] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:43 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:44.228541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-37940523-ce04-4b64-ac41-614d04c58f7b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:44.235636 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-37940523-ce04-4b64-ac41-614d04c58f7b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:44.238222 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-37940523-ce04-4b64-ac41-614d04c58f7b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:44.239380 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-37940523-ce04-4b64-ac41-614d04c58f7b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.283783 Jun 16 18:56:44.242436 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 47/97] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:43 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:44.520673 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-bb36a638-a301-4f67-b45b-65d6bab7324a req-98523a6a-e5ee-4c29-98c1-91764bf40067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "544e6615-4246-45d4-bd9b-18a4ab137989", "name": "network-vif-plugged", "status": "completed", "tag": "c03f9164-b914-4183-b673-f6b558f696da"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:44.530465 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-bb36a638-a301-4f67-b45b-65d6bab7324a req-98523a6a-e5ee-4c29-98c1-91764bf40067 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:44.530967 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-bb36a638-a301-4f67-b45b-65d6bab7324a req-98523a6a-e5ee-4c29-98c1-91764bf40067 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:44.545262 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-bb36a638-a301-4f67-b45b-65d6bab7324a req-98523a6a-e5ee-4c29-98c1-91764bf40067 service nova] Creating event network-vif-plugged:c03f9164-b914-4183-b673-f6b558f696da for instance 544e6615-4246-45d4-bd9b-18a4ab137989 on hv-cinder-84617 Jun 16 18:56:44.550848 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-bb36a638-a301-4f67-b45b-65d6bab7324a req-98523a6a-e5ee-4c29-98c1-91764bf40067 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.368028 Jun 16 18:56:44.552209 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 51/98] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:56:44.631146 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-0fd35c07-fdda-437f-9621-a4df94d5e296 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:44.632542 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-0fd35c07-fdda-437f-9621-a4df94d5e296 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:44.645985 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0fd35c07-fdda-437f-9621-a4df94d5e296 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:44.647646 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0fd35c07-fdda-437f-9621-a4df94d5e296 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:44.649579 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0fd35c07-fdda-437f-9621-a4df94d5e296 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:44.653178 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0fd35c07-fdda-437f-9621-a4df94d5e296 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:44.675444 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f2d9b5e4-ba60-4f38-a144-fd79b46359d8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:44.676669 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f2d9b5e4-ba60-4f38-a144-fd79b46359d8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:44.686046 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f2d9b5e4-ba60-4f38-a144-fd79b46359d8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:44.686915 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f2d9b5e4-ba60-4f38-a144-fd79b46359d8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:44.689317 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f2d9b5e4-ba60-4f38-a144-fd79b46359d8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:44.692533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f2d9b5e4-ba60-4f38-a144-fd79b46359d8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:44.966199 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-0fd35c07-fdda-437f-9621-a4df94d5e296 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:44.980433 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-0fd35c07-fdda-437f-9621-a4df94d5e296 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.354257 Jun 16 18:56:44.990505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 48/99] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:44 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:45.034833 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f2d9b5e4-ba60-4f38-a144-fd79b46359d8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:45.042642 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f2d9b5e4-ba60-4f38-a144-fd79b46359d8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.374425 Jun 16 18:56:45.053426 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 52/100] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:44 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:45.197573 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9ad34577-2ac7-41b2-af7d-de7cda2f0949 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:45.198358 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9ad34577-2ac7-41b2-af7d-de7cda2f0949 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:45.206698 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9ad34577-2ac7-41b2-af7d-de7cda2f0949 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:45.206698 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9ad34577-2ac7-41b2-af7d-de7cda2f0949 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:45.207374 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9ad34577-2ac7-41b2-af7d-de7cda2f0949 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:45.208145 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9ad34577-2ac7-41b2-af7d-de7cda2f0949 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:45.258784 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f938fb26-24eb-4575-a401-aa3b8ce897bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:45.259411 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f938fb26-24eb-4575-a401-aa3b8ce897bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:45.269486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f938fb26-24eb-4575-a401-aa3b8ce897bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:45.270376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f938fb26-24eb-4575-a401-aa3b8ce897bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:45.271339 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f938fb26-24eb-4575-a401-aa3b8ce897bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:45.271782 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f938fb26-24eb-4575-a401-aa3b8ce897bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:45.522563 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9ad34577-2ac7-41b2-af7d-de7cda2f0949 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:45.551507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9ad34577-2ac7-41b2-af7d-de7cda2f0949 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.347216 Jun 16 18:56:45.551507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 49/101] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:45 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:45.551849 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f938fb26-24eb-4575-a401-aa3b8ce897bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:45.574704 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f938fb26-24eb-4575-a401-aa3b8ce897bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:45.574704 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f938fb26-24eb-4575-a401-aa3b8ce897bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:45.574704 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f938fb26-24eb-4575-a401-aa3b8ce897bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.319336 Jun 16 18:56:45.578506 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 53/102] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:45 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:56:46.002674 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a1a0c9f9-491d-4e09-944b-6490bc0f8161 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:46.003470 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a1a0c9f9-491d-4e09-944b-6490bc0f8161 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:46.009535 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a1a0c9f9-491d-4e09-944b-6490bc0f8161 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:46.009985 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a1a0c9f9-491d-4e09-944b-6490bc0f8161 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:46.010749 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a1a0c9f9-491d-4e09-944b-6490bc0f8161 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:46.011183 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a1a0c9f9-491d-4e09-944b-6490bc0f8161 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:46.060990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7a56422d-40b5-4ed3-8d6b-0f126c5bfae0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:46.061723 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7a56422d-40b5-4ed3-8d6b-0f126c5bfae0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:46.069110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7a56422d-40b5-4ed3-8d6b-0f126c5bfae0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:46.069681 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7a56422d-40b5-4ed3-8d6b-0f126c5bfae0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:46.070524 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7a56422d-40b5-4ed3-8d6b-0f126c5bfae0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:46.071029 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7a56422d-40b5-4ed3-8d6b-0f126c5bfae0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:46.235052 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a1a0c9f9-491d-4e09-944b-6490bc0f8161 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:46.242804 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a1a0c9f9-491d-4e09-944b-6490bc0f8161 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.243938 Jun 16 18:56:46.243368 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 50/103] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:45 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:46.268205 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7a56422d-40b5-4ed3-8d6b-0f126c5bfae0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:46.275706 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7a56422d-40b5-4ed3-8d6b-0f126c5bfae0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.219233 Jun 16 18:56:46.276473 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 54/104] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:46 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:46.556042 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-97f6395d-210b-4455-b6f1-f68252db3f74 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:46.556860 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-97f6395d-210b-4455-b6f1-f68252db3f74 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:46.563523 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-97f6395d-210b-4455-b6f1-f68252db3f74 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:46.563982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-97f6395d-210b-4455-b6f1-f68252db3f74 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:46.565989 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-97f6395d-210b-4455-b6f1-f68252db3f74 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:46.566476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-97f6395d-210b-4455-b6f1-f68252db3f74 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:46.566971 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-ad233225-0341-469b-95de-2fdaee3f7164 req-0bddae99-a38f-4d00-bdd3-14b3f5892ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bad769d-1b62-4d0f-8491-bfae3997a525", "name": "network-vif-plugged", "status": "completed", "tag": "813e5e92-6255-46b0-aa69-1964caa13cf4"}, {"server_uuid": "25fe61a4-e1c1-4098-91db-fbb42c8b1d7b", "name": "network-vif-plugged", "status": "completed", "tag": "3e4f94ae-ac05-441d-a1fa-fa6601b9d389"}, {"server_uuid": "d6c04798-b061-421b-9b61-db9cce7dace4", "name": "network-vif-plugged", "status": "completed", "tag": "44fe652d-5231-4810-99fa-21c58c429e9c"}, {"server_uuid": "410bdd70-d5fd-4cfe-ad04-cf135bef00ff", "name": "network-vif-plugged", "status": "completed", "tag": "874e17b1-59b4-455e-93ae-78a55fa69aa1"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:46.583395 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-ad233225-0341-469b-95de-2fdaee3f7164 req-0bddae99-a38f-4d00-bdd3-14b3f5892ecd service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:46.584356 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-ad233225-0341-469b-95de-2fdaee3f7164 req-0bddae99-a38f-4d00-bdd3-14b3f5892ecd service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:46.600336 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-ad233225-0341-469b-95de-2fdaee3f7164 req-0bddae99-a38f-4d00-bdd3-14b3f5892ecd service nova] Creating event network-vif-plugged:813e5e92-6255-46b0-aa69-1964caa13cf4 for instance 8bad769d-1b62-4d0f-8491-bfae3997a525 on hv-cinder-84617 Jun 16 18:56:46.600848 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-ad233225-0341-469b-95de-2fdaee3f7164 req-0bddae99-a38f-4d00-bdd3-14b3f5892ecd service nova] Creating event network-vif-plugged:3e4f94ae-ac05-441d-a1fa-fa6601b9d389 for instance 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b on hv-cinder-84617 Jun 16 18:56:46.601373 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-ad233225-0341-469b-95de-2fdaee3f7164 req-0bddae99-a38f-4d00-bdd3-14b3f5892ecd service nova] Creating event network-vif-plugged:44fe652d-5231-4810-99fa-21c58c429e9c for instance d6c04798-b061-421b-9b61-db9cce7dace4 on hv-cinder-84617 Jun 16 18:56:46.602109 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-ad233225-0341-469b-95de-2fdaee3f7164 req-0bddae99-a38f-4d00-bdd3-14b3f5892ecd service nova] Creating event network-vif-plugged:874e17b1-59b4-455e-93ae-78a55fa69aa1 for instance 410bdd70-d5fd-4cfe-ad04-cf135bef00ff on hv-cinder-84617 Jun 16 18:56:46.621078 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-ad233225-0341-469b-95de-2fdaee3f7164 req-0bddae99-a38f-4d00-bdd3-14b3f5892ecd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.058176 Jun 16 18:56:46.622050 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 55/105] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:56:46.627839 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0070f374-4cf3-445a-845d-8ebc316515e8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:46.628544 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0070f374-4cf3-445a-845d-8ebc316515e8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:46.635424 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0070f374-4cf3-445a-845d-8ebc316515e8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:46.635881 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0070f374-4cf3-445a-845d-8ebc316515e8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:46.636660 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0070f374-4cf3-445a-845d-8ebc316515e8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:46.637102 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0070f374-4cf3-445a-845d-8ebc316515e8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:46.815405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-97f6395d-210b-4455-b6f1-f68252db3f74 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:46.824784 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-97f6395d-210b-4455-b6f1-f68252db3f74 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.272481 Jun 16 18:56:46.825701 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 51/106] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:46 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:46.857443 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0070f374-4cf3-445a-845d-8ebc316515e8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:46.874551 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0070f374-4cf3-445a-845d-8ebc316515e8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:46.877489 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0070f374-4cf3-445a-845d-8ebc316515e8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:46.879404 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0070f374-4cf3-445a-845d-8ebc316515e8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.255742 Jun 16 18:56:46.880667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 56/107] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:46 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:47.263277 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3ce9a7c6-1034-45e5-b2b4-c50fdb09059c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:47.263277 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3ce9a7c6-1034-45e5-b2b4-c50fdb09059c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:47.267489 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3ce9a7c6-1034-45e5-b2b4-c50fdb09059c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:47.268049 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3ce9a7c6-1034-45e5-b2b4-c50fdb09059c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:47.269013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3ce9a7c6-1034-45e5-b2b4-c50fdb09059c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:47.269696 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3ce9a7c6-1034-45e5-b2b4-c50fdb09059c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:47.292724 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-dac19169-ffe8-461f-a588-c50e42e83d1e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:47.293699 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-dac19169-ffe8-461f-a588-c50e42e83d1e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:47.300899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dac19169-ffe8-461f-a588-c50e42e83d1e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:47.301454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dac19169-ffe8-461f-a588-c50e42e83d1e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:47.302601 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dac19169-ffe8-461f-a588-c50e42e83d1e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:47.303319 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dac19169-ffe8-461f-a588-c50e42e83d1e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:47.538062 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-3ce9a7c6-1034-45e5-b2b4-c50fdb09059c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:47.546226 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3ce9a7c6-1034-45e5-b2b4-c50fdb09059c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1314 microversion: 2.1 time: 0.290236 Jun 16 18:56:47.546960 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 52/108] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:47 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:47.559797 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-dac19169-ffe8-461f-a588-c50e42e83d1e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:47.567178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-dac19169-ffe8-461f-a588-c50e42e83d1e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.279143 Jun 16 18:56:47.567727 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 57/109] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:47 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:47.841620 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5f2bb831-a4e5-4494-8571-147404c1d034 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:47.842273 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5f2bb831-a4e5-4494-8571-147404c1d034 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:47.848207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5f2bb831-a4e5-4494-8571-147404c1d034 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:47.848660 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5f2bb831-a4e5-4494-8571-147404c1d034 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:47.850309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5f2bb831-a4e5-4494-8571-147404c1d034 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:47.850309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5f2bb831-a4e5-4494-8571-147404c1d034 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:47.898717 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d20ace7f-dad3-4c38-9afa-c57aa385b4f1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:47.899713 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d20ace7f-dad3-4c38-9afa-c57aa385b4f1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:47.906314 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d20ace7f-dad3-4c38-9afa-c57aa385b4f1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:47.906750 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d20ace7f-dad3-4c38-9afa-c57aa385b4f1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:47.907676 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d20ace7f-dad3-4c38-9afa-c57aa385b4f1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:47.908279 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d20ace7f-dad3-4c38-9afa-c57aa385b4f1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:48.047717 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5f2bb831-a4e5-4494-8571-147404c1d034 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:48.070290 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5f2bb831-a4e5-4494-8571-147404c1d034 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.232499 Jun 16 18:56:48.085819 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 53/110] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:47 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:48.108354 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d20ace7f-dad3-4c38-9afa-c57aa385b4f1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:48.116909 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d20ace7f-dad3-4c38-9afa-c57aa385b4f1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:48.118442 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d20ace7f-dad3-4c38-9afa-c57aa385b4f1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:48.119660 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d20ace7f-dad3-4c38-9afa-c57aa385b4f1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.224910 Jun 16 18:56:48.120225 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 58/111] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:47 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:56:48.562569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3678ba05-6606-49a6-a2e5-849c45c8ed86 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:48.563435 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3678ba05-6606-49a6-a2e5-849c45c8ed86 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:48.570319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3678ba05-6606-49a6-a2e5-849c45c8ed86 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:48.571786 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3678ba05-6606-49a6-a2e5-849c45c8ed86 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:48.572770 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3678ba05-6606-49a6-a2e5-849c45c8ed86 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:48.573488 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3678ba05-6606-49a6-a2e5-849c45c8ed86 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:48.587919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7c91e2dc-eba1-4e17-acc2-5f32675630ba tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:48.590470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7c91e2dc-eba1-4e17-acc2-5f32675630ba tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:48.595179 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c91e2dc-eba1-4e17-acc2-5f32675630ba tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:48.595624 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c91e2dc-eba1-4e17-acc2-5f32675630ba tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:48.596385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c91e2dc-eba1-4e17-acc2-5f32675630ba tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:48.596851 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c91e2dc-eba1-4e17-acc2-5f32675630ba tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:48.768832 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-3678ba05-6606-49a6-a2e5-849c45c8ed86 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:48.776480 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3678ba05-6606-49a6-a2e5-849c45c8ed86 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1501 microversion: 2.1 time: 0.217786 Jun 16 18:56:48.785508 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 54/112] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:48 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1501 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:48.793179 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7c91e2dc-eba1-4e17-acc2-5f32675630ba tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:48.800859 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7c91e2dc-eba1-4e17-acc2-5f32675630ba tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.216773 Jun 16 18:56:48.801630 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 59/113] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:48 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:49.097598 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e3369f27-b2b5-4ac5-9d91-0880c357eae5 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:49.097598 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e3369f27-b2b5-4ac5-9d91-0880c357eae5 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:49.104698 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e3369f27-b2b5-4ac5-9d91-0880c357eae5 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:49.105150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e3369f27-b2b5-4ac5-9d91-0880c357eae5 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:49.107148 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e3369f27-b2b5-4ac5-9d91-0880c357eae5 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:49.107612 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e3369f27-b2b5-4ac5-9d91-0880c357eae5 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:49.139695 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-070d7ace-5044-4a6a-8a92-dcb727878759 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:49.140659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-070d7ace-5044-4a6a-8a92-dcb727878759 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:49.147826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-070d7ace-5044-4a6a-8a92-dcb727878759 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:49.148460 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-070d7ace-5044-4a6a-8a92-dcb727878759 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:49.149463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-070d7ace-5044-4a6a-8a92-dcb727878759 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:49.150226 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-070d7ace-5044-4a6a-8a92-dcb727878759 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:49.357913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-070d7ace-5044-4a6a-8a92-dcb727878759 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:49.361159 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e3369f27-b2b5-4ac5-9d91-0880c357eae5 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:49.369659 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e3369f27-b2b5-4ac5-9d91-0880c357eae5 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.276223 Jun 16 18:56:49.370591 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 55/114] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:49 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:49.374834 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-070d7ace-5044-4a6a-8a92-dcb727878759 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:49.374834 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-070d7ace-5044-4a6a-8a92-dcb727878759 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:49.375553 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-070d7ace-5044-4a6a-8a92-dcb727878759 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1406 microversion: 2.20 time: 0.240313 Jun 16 18:56:49.376091 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 60/115] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:49 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:49.820988 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9d8885ff-4548-42ee-9d40-b636a60ac64b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:49.820988 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9d8885ff-4548-42ee-9d40-b636a60ac64b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:49.827159 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9d8885ff-4548-42ee-9d40-b636a60ac64b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:49.827679 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9d8885ff-4548-42ee-9d40-b636a60ac64b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:49.828445 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9d8885ff-4548-42ee-9d40-b636a60ac64b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:49.829058 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9d8885ff-4548-42ee-9d40-b636a60ac64b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:49.976180 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9d8885ff-4548-42ee-9d40-b636a60ac64b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:49.984476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9d8885ff-4548-42ee-9d40-b636a60ac64b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1321 microversion: 2.1 time: 0.169528 Jun 16 18:56:49.985023 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 56/116] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:49 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:50.388387 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-aaca3b5e-c456-4103-9a28-57e9e514e8ce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:50.389589 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-aaca3b5e-c456-4103-9a28-57e9e514e8ce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:50.393648 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-78d4c332-facd-44f3-afc3-bdacbd3b5f14 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:50.394360 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-78d4c332-facd-44f3-afc3-bdacbd3b5f14 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:50.396214 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-aaca3b5e-c456-4103-9a28-57e9e514e8ce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:50.396890 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-aaca3b5e-c456-4103-9a28-57e9e514e8ce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:50.397686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-aaca3b5e-c456-4103-9a28-57e9e514e8ce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:50.398402 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-aaca3b5e-c456-4103-9a28-57e9e514e8ce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:50.406518 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-78d4c332-facd-44f3-afc3-bdacbd3b5f14 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:50.407114 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-78d4c332-facd-44f3-afc3-bdacbd3b5f14 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:50.410283 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-78d4c332-facd-44f3-afc3-bdacbd3b5f14 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:50.410830 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-78d4c332-facd-44f3-afc3-bdacbd3b5f14 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:50.608339 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-aaca3b5e-c456-4103-9a28-57e9e514e8ce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:50.611797 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-78d4c332-facd-44f3-afc3-bdacbd3b5f14 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:50.615317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=100 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:50.620070 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-aaca3b5e-c456-4103-9a28-57e9e514e8ce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1361 microversion: 2.1 time: 0.236618 Jun 16 18:56:50.620796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-78d4c332-facd-44f3-afc3-bdacbd3b5f14 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:50.635250 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-78d4c332-facd-44f3-afc3-bdacbd3b5f14 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:50.635250 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-78d4c332-facd-44f3-afc3-bdacbd3b5f14 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1598 microversion: 2.20 time: 0.234465 Jun 16 18:56:50.635736 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 61/117] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:50 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:50.635837 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 57/118] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:56:50 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1598 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:56:50.642470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d7f8a1b4-9bc8-45ca-ad60-82d256e8463c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:50.642974 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d7f8a1b4-9bc8-45ca-ad60-82d256e8463c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:50.648939 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d7f8a1b4-9bc8-45ca-ad60-82d256e8463c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:50.649492 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d7f8a1b4-9bc8-45ca-ad60-82d256e8463c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:50.650194 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d7f8a1b4-9bc8-45ca-ad60-82d256e8463c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:50.650631 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d7f8a1b4-9bc8-45ca-ad60-82d256e8463c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:50.678606 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=100 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:50.780795 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d7f8a1b4-9bc8-45ca-ad60-82d256e8463c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.141346 Jun 16 18:56:50.780795 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 62/119] 10.222.0.81 () {60 vars in 1315 bytes} [Thu Jun 16 18:56:50 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:56:50.847413 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-65db20e0-d5d7-49cb-9d13-215e72c004a8 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e3f1f5e-3c7a-439d-ac97-34dfcefdacd2"}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:50.848794 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-65db20e0-d5d7-49cb-9d13-215e72c004a8 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:50.865315 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-65db20e0-d5d7-49cb-9d13-215e72c004a8 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:50.866728 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-65db20e0-d5d7-49cb-9d13-215e72c004a8 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:50.866728 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-65db20e0-d5d7-49cb-9d13-215e72c004a8 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:50.866962 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-65db20e0-d5d7-49cb-9d13-215e72c004a8 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:51.001348 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-fd7970ad-4ca8-4169-9008-a02c74ffc7ee tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:51.002979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-fd7970ad-4ca8-4169-9008-a02c74ffc7ee tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:51.009571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fd7970ad-4ca8-4169-9008-a02c74ffc7ee tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:51.010015 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fd7970ad-4ca8-4169-9008-a02c74ffc7ee tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:51.010828 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fd7970ad-4ca8-4169-9008-a02c74ffc7ee tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:51.011250 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fd7970ad-4ca8-4169-9008-a02c74ffc7ee tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:51.170005 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-fd7970ad-4ca8-4169-9008-a02c74ffc7ee tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:51.178830 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-fd7970ad-4ca8-4169-9008-a02c74ffc7ee tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1515 microversion: 2.1 time: 0.182104 Jun 16 18:56:51.179772 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 63/120] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:50 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:51.202501 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-152062dd-0e0d-4fd8-8e60-77716811492f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:51.202501 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-152062dd-0e0d-4fd8-8e60-77716811492f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:51.205579 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-152062dd-0e0d-4fd8-8e60-77716811492f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:51.206139 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-152062dd-0e0d-4fd8-8e60-77716811492f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:51.207078 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-152062dd-0e0d-4fd8-8e60-77716811492f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:51.207716 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-152062dd-0e0d-4fd8-8e60-77716811492f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:51.233810 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-152062dd-0e0d-4fd8-8e60-77716811492f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lazy-loading 'flavor' on Instance uuid 410bdd70-d5fd-4cfe-ad04-cf135bef00ff {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:56:51.512459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-152062dd-0e0d-4fd8-8e60-77716811492f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "POST /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff/action" status: 200 len: 32 microversion: 2.1 time: 0.320096 Jun 16 18:56:51.513665 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 64/121] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jun 16 18:56:51 2022] POST /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff/action => generated 32 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:56:51.523516 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-13cb3b41-eeca-49dc-aadd-57bf09d088fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:51.524392 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-13cb3b41-eeca-49dc-aadd-57bf09d088fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:51.532601 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-13cb3b41-eeca-49dc-aadd-57bf09d088fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:51.532601 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-13cb3b41-eeca-49dc-aadd-57bf09d088fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:51.535316 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-13cb3b41-eeca-49dc-aadd-57bf09d088fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:51.535316 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-13cb3b41-eeca-49dc-aadd-57bf09d088fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:51.703541 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-13cb3b41-eeca-49dc-aadd-57bf09d088fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:51.712474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-13cb3b41-eeca-49dc-aadd-57bf09d088fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.192975 Jun 16 18:56:51.723184 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 65/122] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:51 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:51.723184 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f7122969-65db-4332-8a38-b82d22ca6050 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:51.723184 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f7122969-65db-4332-8a38-b82d22ca6050 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:51.728145 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f7122969-65db-4332-8a38-b82d22ca6050 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:51.728773 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f7122969-65db-4332-8a38-b82d22ca6050 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:51.729570 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f7122969-65db-4332-8a38-b82d22ca6050 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:51.730002 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f7122969-65db-4332-8a38-b82d22ca6050 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:51.878999 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f7122969-65db-4332-8a38-b82d22ca6050 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:51.888372 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f7122969-65db-4332-8a38-b82d22ca6050 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1546 microversion: 2.1 time: 0.173124 Jun 16 18:56:51.889304 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 66/123] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:51 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1546 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:51.907258 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-bc0ed00a-4107-46cf-a1d2-1ea31136dec3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:51.907836 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-bc0ed00a-4107-46cf-a1d2-1ea31136dec3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:51.922244 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bc0ed00a-4107-46cf-a1d2-1ea31136dec3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:51.922244 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bc0ed00a-4107-46cf-a1d2-1ea31136dec3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:51.922244 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bc0ed00a-4107-46cf-a1d2-1ea31136dec3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:51.922244 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bc0ed00a-4107-46cf-a1d2-1ea31136dec3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:52.026801 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-bc0ed00a-4107-46cf-a1d2-1ea31136dec3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123415 Jun 16 18:56:52.033758 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 67/124] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jun 16 18:56:51 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:56:52.384892 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-148d0b2c-f557-49db-87c5-d0877ebe172b req-947da330-3a8d-4ea9-916d-2745b035429e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c04798-b061-421b-9b61-db9cce7dace4", "tag": "44fe652d-5231-4810-99fa-21c58c429e9c"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:52.394748 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-148d0b2c-f557-49db-87c5-d0877ebe172b req-947da330-3a8d-4ea9-916d-2745b035429e service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:52.395188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-148d0b2c-f557-49db-87c5-d0877ebe172b req-947da330-3a8d-4ea9-916d-2745b035429e service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:52.407131 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-148d0b2c-f557-49db-87c5-d0877ebe172b req-947da330-3a8d-4ea9-916d-2745b035429e service nova] Creating event network-changed:44fe652d-5231-4810-99fa-21c58c429e9c for instance d6c04798-b061-421b-9b61-db9cce7dace4 on hv-cinder-84617 Jun 16 18:56:52.412737 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-148d0b2c-f557-49db-87c5-d0877ebe172b req-947da330-3a8d-4ea9-916d-2745b035429e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031332 Jun 16 18:56:52.416216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 68/125] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:56:52.733723 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4d5a3509-80b2-4717-8ed4-aeca470cacb0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:52.733723 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4d5a3509-80b2-4717-8ed4-aeca470cacb0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:52.740111 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d5a3509-80b2-4717-8ed4-aeca470cacb0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:52.740880 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d5a3509-80b2-4717-8ed4-aeca470cacb0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:52.741683 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d5a3509-80b2-4717-8ed4-aeca470cacb0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:52.742120 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d5a3509-80b2-4717-8ed4-aeca470cacb0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:53.042762 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4d5a3509-80b2-4717-8ed4-aeca470cacb0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:53.050680 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4d5a3509-80b2-4717-8ed4-aeca470cacb0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.323386 Jun 16 18:56:53.051340 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 69/126] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:52 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:53.720021 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-b0c047bf-cbbc-4532-87eb-5c1b68788264 req-7ec0a6d3-97e4-4d3d-bb9c-0b68afb9aacd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bad769d-1b62-4d0f-8491-bfae3997a525", "tag": "813e5e92-6255-46b0-aa69-1964caa13cf4"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:56:53.730829 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-b0c047bf-cbbc-4532-87eb-5c1b68788264 req-7ec0a6d3-97e4-4d3d-bb9c-0b68afb9aacd service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:53.731458 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-b0c047bf-cbbc-4532-87eb-5c1b68788264 req-7ec0a6d3-97e4-4d3d-bb9c-0b68afb9aacd service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:53.743678 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-b0c047bf-cbbc-4532-87eb-5c1b68788264 req-7ec0a6d3-97e4-4d3d-bb9c-0b68afb9aacd service nova] Creating event network-changed:813e5e92-6255-46b0-aa69-1964caa13cf4 for instance 8bad769d-1b62-4d0f-8491-bfae3997a525 on hv-cinder-84617 Jun 16 18:56:53.749217 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-b0c047bf-cbbc-4532-87eb-5c1b68788264 req-7ec0a6d3-97e4-4d3d-bb9c-0b68afb9aacd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035152 Jun 16 18:56:53.754525 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 70/127] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:56:54.069572 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a50b041e-f68e-4d46-8e37-78f59704135f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:54.070818 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a50b041e-f68e-4d46-8e37-78f59704135f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:54.084673 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a50b041e-f68e-4d46-8e37-78f59704135f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:54.088555 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a50b041e-f68e-4d46-8e37-78f59704135f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:54.090302 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a50b041e-f68e-4d46-8e37-78f59704135f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:54.092055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a50b041e-f68e-4d46-8e37-78f59704135f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:54.289372 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a50b041e-f68e-4d46-8e37-78f59704135f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:54.300794 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a50b041e-f68e-4d46-8e37-78f59704135f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.236843 Jun 16 18:56:54.301665 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 71/128] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:54 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:56:55.319522 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-571b09c2-379b-4b1d-b7c3-7820a02e0a84 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:55.320837 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-571b09c2-379b-4b1d-b7c3-7820a02e0a84 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:55.330153 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-571b09c2-379b-4b1d-b7c3-7820a02e0a84 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:55.337031 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-571b09c2-379b-4b1d-b7c3-7820a02e0a84 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:55.337031 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-571b09c2-379b-4b1d-b7c3-7820a02e0a84 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:55.337031 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-571b09c2-379b-4b1d-b7c3-7820a02e0a84 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:55.788036 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-65db20e0-d5d7-49cb-9d13-215e72c004a8 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "POST /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.947936 Jun 16 18:56:55.790085 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 58/129] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jun 16 18:56:50 2022] POST /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989/os-volume_attachments => generated 194 bytes in 4951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:56:55.917145 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-571b09c2-379b-4b1d-b7c3-7820a02e0a84 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:55.928744 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-571b09c2-379b-4b1d-b7c3-7820a02e0a84 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.614055 Jun 16 18:56:55.930596 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 72/130] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:55 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:56.960069 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ce15fd0d-a43d-4ede-b9ca-d3db7545026c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:56.961339 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ce15fd0d-a43d-4ede-b9ca-d3db7545026c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:56.964048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=79 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:56:56.970439 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ce15fd0d-a43d-4ede-b9ca-d3db7545026c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:56.971067 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ce15fd0d-a43d-4ede-b9ca-d3db7545026c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:56.971999 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ce15fd0d-a43d-4ede-b9ca-d3db7545026c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:56.972602 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ce15fd0d-a43d-4ede-b9ca-d3db7545026c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:57.162874 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ce15fd0d-a43d-4ede-b9ca-d3db7545026c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:57.171016 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ce15fd0d-a43d-4ede-b9ca-d3db7545026c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.215426 Jun 16 18:56:57.171588 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 59/131] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:56 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:58.189075 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b74bb3bf-a079-4e61-864c-a61fdc1bde20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:58.189923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b74bb3bf-a079-4e61-864c-a61fdc1bde20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:58.197323 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b74bb3bf-a079-4e61-864c-a61fdc1bde20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:58.197323 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b74bb3bf-a079-4e61-864c-a61fdc1bde20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:58.197533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b74bb3bf-a079-4e61-864c-a61fdc1bde20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:58.198006 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b74bb3bf-a079-4e61-864c-a61fdc1bde20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:58.404796 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b74bb3bf-a079-4e61-864c-a61fdc1bde20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:58.419441 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b74bb3bf-a079-4e61-864c-a61fdc1bde20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.233519 Jun 16 18:56:58.420493 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 73/132] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:58 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:56:59.436841 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-85e4cd51-bdcf-4a21-b2c2-021ec3e7cbad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:56:59.437483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-85e4cd51-bdcf-4a21-b2c2-021ec3e7cbad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:56:59.445265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-85e4cd51-bdcf-4a21-b2c2-021ec3e7cbad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:59.452645 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-85e4cd51-bdcf-4a21-b2c2-021ec3e7cbad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:59.452645 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-85e4cd51-bdcf-4a21-b2c2-021ec3e7cbad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:56:59.452645 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-85e4cd51-bdcf-4a21-b2c2-021ec3e7cbad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:56:59.596805 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-85e4cd51-bdcf-4a21-b2c2-021ec3e7cbad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:56:59.604360 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-85e4cd51-bdcf-4a21-b2c2-021ec3e7cbad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.172347 Jun 16 18:56:59.604931 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 60/133] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:56:59 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:00.622487 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-05e6dc6c-6c80-4bf7-bf73-927705088507 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:00.623122 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-05e6dc6c-6c80-4bf7-bf73-927705088507 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:00.632464 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=97 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:00.634104 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-05e6dc6c-6c80-4bf7-bf73-927705088507 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:00.636514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-05e6dc6c-6c80-4bf7-bf73-927705088507 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:00.638796 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-05e6dc6c-6c80-4bf7-bf73-927705088507 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:00.639618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-05e6dc6c-6c80-4bf7-bf73-927705088507 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:00.781903 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-05e6dc6c-6c80-4bf7-bf73-927705088507 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:00.789485 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-05e6dc6c-6c80-4bf7-bf73-927705088507 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.171533 Jun 16 18:57:00.790034 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 74/134] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:00 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:01.812907 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3e040fbd-0c36-4f88-9dd0-d23ef9ddb1e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:01.812907 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3e040fbd-0c36-4f88-9dd0-d23ef9ddb1e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:01.821360 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3e040fbd-0c36-4f88-9dd0-d23ef9ddb1e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:01.821360 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3e040fbd-0c36-4f88-9dd0-d23ef9ddb1e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:01.821834 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3e040fbd-0c36-4f88-9dd0-d23ef9ddb1e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:01.822372 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3e040fbd-0c36-4f88-9dd0-d23ef9ddb1e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:02.009163 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-3e040fbd-0c36-4f88-9dd0-d23ef9ddb1e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:02.018878 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3e040fbd-0c36-4f88-9dd0-d23ef9ddb1e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.214341 Jun 16 18:57:02.019474 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 61/135] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:01 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:03.036777 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-dcfebedf-17f2-493f-8320-7faf56588222 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:03.037413 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-dcfebedf-17f2-493f-8320-7faf56588222 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:03.045593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dcfebedf-17f2-493f-8320-7faf56588222 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:03.046043 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dcfebedf-17f2-493f-8320-7faf56588222 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:03.046801 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dcfebedf-17f2-493f-8320-7faf56588222 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:03.047399 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dcfebedf-17f2-493f-8320-7faf56588222 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:03.194236 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-dcfebedf-17f2-493f-8320-7faf56588222 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:03.202771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-dcfebedf-17f2-493f-8320-7faf56588222 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.170611 Jun 16 18:57:03.203510 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 75/136] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:03 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:04.220349 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e78b8fc3-b8a9-4c83-83bc-b053ce15c02a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:04.220975 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e78b8fc3-b8a9-4c83-83bc-b053ce15c02a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:04.228082 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e78b8fc3-b8a9-4c83-83bc-b053ce15c02a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:04.234555 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e78b8fc3-b8a9-4c83-83bc-b053ce15c02a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:04.235835 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e78b8fc3-b8a9-4c83-83bc-b053ce15c02a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:04.236595 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e78b8fc3-b8a9-4c83-83bc-b053ce15c02a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:04.379571 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e78b8fc3-b8a9-4c83-83bc-b053ce15c02a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:04.384618 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e78b8fc3-b8a9-4c83-83bc-b053ce15c02a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.168539 Jun 16 18:57:04.385292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 62/137] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:04 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:04.993587 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5ea4cb05-fba7-45c3-970c-77e9f1f91a29 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:04.994423 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5ea4cb05-fba7-45c3-970c-77e9f1f91a29 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:05.001056 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5ea4cb05-fba7-45c3-970c-77e9f1f91a29 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:05.001736 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5ea4cb05-fba7-45c3-970c-77e9f1f91a29 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:05.002518 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5ea4cb05-fba7-45c3-970c-77e9f1f91a29 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:05.002974 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5ea4cb05-fba7-45c3-970c-77e9f1f91a29 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:05.037584 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5ea4cb05-fba7-45c3-970c-77e9f1f91a29 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Going to try to terminate instance {{(pid=130229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:57:05.401408 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e5a7bc07-2932-4c20-9abf-3d956e63d2fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:05.402043 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e5a7bc07-2932-4c20-9abf-3d956e63d2fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:05.409016 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e5a7bc07-2932-4c20-9abf-3d956e63d2fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:05.409493 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e5a7bc07-2932-4c20-9abf-3d956e63d2fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:05.410251 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e5a7bc07-2932-4c20-9abf-3d956e63d2fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:05.410683 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e5a7bc07-2932-4c20-9abf-3d956e63d2fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:05.450501 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5ea4cb05-fba7-45c3-970c-77e9f1f91a29 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "DELETE /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 204 len: 0 microversion: 2.1 time: 0.460476 Jun 16 18:57:05.451024 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 76/138] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 18:57:04 2022] DELETE /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:57:05.461977 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b3200e2f-67d3-476d-b56d-d87df9f1402e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:05.462681 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b3200e2f-67d3-476d-b56d-d87df9f1402e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:05.469916 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b3200e2f-67d3-476d-b56d-d87df9f1402e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:05.470355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b3200e2f-67d3-476d-b56d-d87df9f1402e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:05.471162 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b3200e2f-67d3-476d-b56d-d87df9f1402e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:05.471699 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b3200e2f-67d3-476d-b56d-d87df9f1402e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:05.477108 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:05.602873 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e5a7bc07-2932-4c20-9abf-3d956e63d2fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:05.611421 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e5a7bc07-2932-4c20-9abf-3d956e63d2fa tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.213856 Jun 16 18:57:05.611997 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 63/139] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:05 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:57:05.633063 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b3200e2f-67d3-476d-b56d-d87df9f1402e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:05.642188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b3200e2f-67d3-476d-b56d-d87df9f1402e tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1553 microversion: 2.1 time: 0.184659 Jun 16 18:57:05.642776 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 77/140] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:05 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:06.628474 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-302974f3-4f9c-4295-8700-37128efac506 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:06.629091 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-302974f3-4f9c-4295-8700-37128efac506 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:06.635615 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-302974f3-4f9c-4295-8700-37128efac506 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:06.636087 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-302974f3-4f9c-4295-8700-37128efac506 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:06.636845 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-302974f3-4f9c-4295-8700-37128efac506 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:06.637302 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-302974f3-4f9c-4295-8700-37128efac506 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:06.660070 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-56567e69-39da-48aa-aef5-d0d28ffd503b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:06.660817 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-56567e69-39da-48aa-aef5-d0d28ffd503b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:06.667164 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-56567e69-39da-48aa-aef5-d0d28ffd503b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:06.667612 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-56567e69-39da-48aa-aef5-d0d28ffd503b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:06.669281 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-56567e69-39da-48aa-aef5-d0d28ffd503b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:06.679625 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-56567e69-39da-48aa-aef5-d0d28ffd503b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:06.822379 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-302974f3-4f9c-4295-8700-37128efac506 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:06.830896 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-302974f3-4f9c-4295-8700-37128efac506 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.206283 Jun 16 18:57:06.831545 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 64/141] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:06 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:06.857470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-56567e69-39da-48aa-aef5-d0d28ffd503b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:06.865570 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-56567e69-39da-48aa-aef5-d0d28ffd503b tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1553 microversion: 2.1 time: 0.209518 Jun 16 18:57:06.866132 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 78/142] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:06 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:57:07.848385 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-412ecfca-869c-4c6e-af6d-38ed59cc0367 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:07.848999 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-412ecfca-869c-4c6e-af6d-38ed59cc0367 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:07.857258 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-412ecfca-869c-4c6e-af6d-38ed59cc0367 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:07.857710 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-412ecfca-869c-4c6e-af6d-38ed59cc0367 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:07.858472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-412ecfca-869c-4c6e-af6d-38ed59cc0367 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:07.858913 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-412ecfca-869c-4c6e-af6d-38ed59cc0367 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:07.883075 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6886a2fb-5e07-4fab-8f13-f859d69a0e8a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:07.883744 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6886a2fb-5e07-4fab-8f13-f859d69a0e8a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:07.890213 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6886a2fb-5e07-4fab-8f13-f859d69a0e8a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:07.890659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6886a2fb-5e07-4fab-8f13-f859d69a0e8a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:07.891422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6886a2fb-5e07-4fab-8f13-f859d69a0e8a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:07.891858 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6886a2fb-5e07-4fab-8f13-f859d69a0e8a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:08.061652 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-412ecfca-869c-4c6e-af6d-38ed59cc0367 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:08.071770 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-412ecfca-869c-4c6e-af6d-38ed59cc0367 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.227127 Jun 16 18:57:08.073188 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 65/143] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:07 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:08.087843 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6886a2fb-5e07-4fab-8f13-f859d69a0e8a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:08.097605 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6886a2fb-5e07-4fab-8f13-f859d69a0e8a tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1553 microversion: 2.1 time: 0.218353 Jun 16 18:57:08.098344 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 79/144] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:07 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:57:09.089065 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-60bb9dbe-4d87-4542-ab4b-19aec526a0dd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:09.089859 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-60bb9dbe-4d87-4542-ab4b-19aec526a0dd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:09.096439 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-60bb9dbe-4d87-4542-ab4b-19aec526a0dd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:09.096890 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-60bb9dbe-4d87-4542-ab4b-19aec526a0dd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:09.097685 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-60bb9dbe-4d87-4542-ab4b-19aec526a0dd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:09.098144 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-60bb9dbe-4d87-4542-ab4b-19aec526a0dd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:09.114782 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-324284b9-3dd9-44a8-a4d2-ea5763368dd4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:09.115459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-324284b9-3dd9-44a8-a4d2-ea5763368dd4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:09.122156 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-324284b9-3dd9-44a8-a4d2-ea5763368dd4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:09.122711 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-324284b9-3dd9-44a8-a4d2-ea5763368dd4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:09.123558 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-324284b9-3dd9-44a8-a4d2-ea5763368dd4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:09.124066 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-324284b9-3dd9-44a8-a4d2-ea5763368dd4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:09.308165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-324284b9-3dd9-44a8-a4d2-ea5763368dd4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:09.314554 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-60bb9dbe-4d87-4542-ab4b-19aec526a0dd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:09.317154 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-324284b9-3dd9-44a8-a4d2-ea5763368dd4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1553 microversion: 2.1 time: 0.206115 Jun 16 18:57:09.318111 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 80/145] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:09 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:57:09.322815 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-60bb9dbe-4d87-4542-ab4b-19aec526a0dd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.237491 Jun 16 18:57:09.333697 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 66/146] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:09 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:10.335095 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f8f938ec-cc21-4570-b34c-031b17f58ff9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:10.341028 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f8f938ec-cc21-4570-b34c-031b17f58ff9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:10.343183 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2ec0c580-6fda-4f8a-9248-4bc9c9cbc471 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:10.344533 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2ec0c580-6fda-4f8a-9248-4bc9c9cbc471 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:10.352866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2ec0c580-6fda-4f8a-9248-4bc9c9cbc471 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:10.353673 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2ec0c580-6fda-4f8a-9248-4bc9c9cbc471 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:10.354830 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2ec0c580-6fda-4f8a-9248-4bc9c9cbc471 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:10.356989 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2ec0c580-6fda-4f8a-9248-4bc9c9cbc471 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:10.366470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f8f938ec-cc21-4570-b34c-031b17f58ff9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:10.366923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f8f938ec-cc21-4570-b34c-031b17f58ff9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:10.367823 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f8f938ec-cc21-4570-b34c-031b17f58ff9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:10.368115 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f8f938ec-cc21-4570-b34c-031b17f58ff9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:10.490476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f8f938ec-cc21-4570-b34c-031b17f58ff9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:10.505133 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f8f938ec-cc21-4570-b34c-031b17f58ff9 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1511 microversion: 2.1 time: 0.169565 Jun 16 18:57:10.506242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 81/147] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:10 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:10.510995 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-bf27fd8a-d24f-49ef-ab8a-def636730fd2 req-6e5d1aed-3b2a-410b-bee4-5092a747452f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "544e6615-4246-45d4-bd9b-18a4ab137989", "name": "network-vif-deleted", "tag": "c03f9164-b914-4183-b673-f6b558f696da"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:57:10.520270 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-bf27fd8a-d24f-49ef-ab8a-def636730fd2 req-6e5d1aed-3b2a-410b-bee4-5092a747452f service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:10.520707 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-bf27fd8a-d24f-49ef-ab8a-def636730fd2 req-6e5d1aed-3b2a-410b-bee4-5092a747452f service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:10.532350 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-bf27fd8a-d24f-49ef-ab8a-def636730fd2 req-6e5d1aed-3b2a-410b-bee4-5092a747452f service nova] Creating event network-vif-deleted:c03f9164-b914-4183-b673-f6b558f696da for instance 544e6615-4246-45d4-bd9b-18a4ab137989 on hv-cinder-84617 Jun 16 18:57:10.538311 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-bf27fd8a-d24f-49ef-ab8a-def636730fd2 req-6e5d1aed-3b2a-410b-bee4-5092a747452f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030864 Jun 16 18:57:10.539272 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 82/148] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:10.606037 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2ec0c580-6fda-4f8a-9248-4bc9c9cbc471 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:10.613772 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2ec0c580-6fda-4f8a-9248-4bc9c9cbc471 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.276844 Jun 16 18:57:10.614341 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 67/149] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:10 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:57:11.524370 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7d8aa4c2-d674-4d76-83f3-500af79c1374 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:11.525085 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7d8aa4c2-d674-4d76-83f3-500af79c1374 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:11.547927 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7d8aa4c2-d674-4d76-83f3-500af79c1374 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:11.548353 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7d8aa4c2-d674-4d76-83f3-500af79c1374 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:11.549204 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7d8aa4c2-d674-4d76-83f3-500af79c1374 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:11.549671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7d8aa4c2-d674-4d76-83f3-500af79c1374 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:11.622864 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7d8aa4c2-d674-4d76-83f3-500af79c1374 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:11.632469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ea4e128b-c6d2-412f-a2b6-739f15819537 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:11.632984 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7d8aa4c2-d674-4d76-83f3-500af79c1374 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1511 microversion: 2.1 time: 0.113854 Jun 16 18:57:11.633328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ea4e128b-c6d2-412f-a2b6-739f15819537 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:11.633545 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 83/150] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:11 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1511 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:11.641024 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ea4e128b-c6d2-412f-a2b6-739f15819537 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:11.641742 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ea4e128b-c6d2-412f-a2b6-739f15819537 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:11.642799 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ea4e128b-c6d2-412f-a2b6-739f15819537 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:11.643244 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ea4e128b-c6d2-412f-a2b6-739f15819537 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:11.777276 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ea4e128b-c6d2-412f-a2b6-739f15819537 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:11.785898 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ea4e128b-c6d2-412f-a2b6-739f15819537 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.158023 Jun 16 18:57:11.786987 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 68/151] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:11 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:12.651382 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6c2d163c-bda9-420c-9814-8c4f967ce41d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:12.651999 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6c2d163c-bda9-420c-9814-8c4f967ce41d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:12.658182 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c2d163c-bda9-420c-9814-8c4f967ce41d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:12.658630 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c2d163c-bda9-420c-9814-8c4f967ce41d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:12.659397 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c2d163c-bda9-420c-9814-8c4f967ce41d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:12.659837 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c2d163c-bda9-420c-9814-8c4f967ce41d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:12.723660 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6c2d163c-bda9-420c-9814-8c4f967ce41d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:12.732267 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6c2d163c-bda9-420c-9814-8c4f967ce41d tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1345 microversion: 2.1 time: 0.085135 Jun 16 18:57:12.732787 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 84/152] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:12 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:12.802359 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5af8f3ea-63ca-4da7-9c08-790b40818d06 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:12.803491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5af8f3ea-63ca-4da7-9c08-790b40818d06 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:12.810929 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5af8f3ea-63ca-4da7-9c08-790b40818d06 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:12.811554 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5af8f3ea-63ca-4da7-9c08-790b40818d06 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:12.812489 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5af8f3ea-63ca-4da7-9c08-790b40818d06 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:12.813139 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5af8f3ea-63ca-4da7-9c08-790b40818d06 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:12.955564 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5af8f3ea-63ca-4da7-9c08-790b40818d06 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:12.964409 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5af8f3ea-63ca-4da7-9c08-790b40818d06 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.165812 Jun 16 18:57:12.964984 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 69/153] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:12 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:13.748258 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f7877010-75cc-42cb-bbdb-bae5d33b0675 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:13.748907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f7877010-75cc-42cb-bbdb-bae5d33b0675 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:13.754937 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f7877010-75cc-42cb-bbdb-bae5d33b0675 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:13.755386 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f7877010-75cc-42cb-bbdb-bae5d33b0675 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:13.756150 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f7877010-75cc-42cb-bbdb-bae5d33b0675 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:13.756587 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f7877010-75cc-42cb-bbdb-bae5d33b0675 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:13.816844 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f7877010-75cc-42cb-bbdb-bae5d33b0675 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:13.825314 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f7877010-75cc-42cb-bbdb-bae5d33b0675 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1345 microversion: 2.1 time: 0.080981 Jun 16 18:57:13.825883 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 85/154] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:13 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:13.983049 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-42c4389e-9cd5-4ed4-8238-3e7ba7abae0d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:13.983672 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-42c4389e-9cd5-4ed4-8238-3e7ba7abae0d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:13.989918 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-42c4389e-9cd5-4ed4-8238-3e7ba7abae0d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:13.990373 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-42c4389e-9cd5-4ed4-8238-3e7ba7abae0d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:13.991144 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-42c4389e-9cd5-4ed4-8238-3e7ba7abae0d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:13.991583 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-42c4389e-9cd5-4ed4-8238-3e7ba7abae0d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:14.186220 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-42c4389e-9cd5-4ed4-8238-3e7ba7abae0d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:14.195167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-42c4389e-9cd5-4ed4-8238-3e7ba7abae0d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.217691 Jun 16 18:57:14.195911 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 70/155] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:13 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:14.842898 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8eaee000-ffc2-4fd2-b2f7-97517f563593 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:14.843538 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8eaee000-ffc2-4fd2-b2f7-97517f563593 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:14.850252 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8eaee000-ffc2-4fd2-b2f7-97517f563593 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:14.850699 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8eaee000-ffc2-4fd2-b2f7-97517f563593 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:14.851456 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8eaee000-ffc2-4fd2-b2f7-97517f563593 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:14.851887 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8eaee000-ffc2-4fd2-b2f7-97517f563593 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:14.895342 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8eaee000-ffc2-4fd2-b2f7-97517f563593 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:14.895342 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8eaee000-ffc2-4fd2-b2f7-97517f563593 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:14.895342 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-8eaee000-ffc2-4fd2-b2f7-97517f563593 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lazy-loading 'fault' on Instance uuid 544e6615-4246-45d4-bd9b-18a4ab137989 {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:57:14.939010 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8eaee000-ffc2-4fd2-b2f7-97517f563593 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:14.947129 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8eaee000-ffc2-4fd2-b2f7-97517f563593 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1350 microversion: 2.1 time: 0.108851 Jun 16 18:57:14.947693 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 86/156] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:14 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:57:15.212266 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-82f8d68d-5bb3-457f-aa49-ae1a1870eef2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:15.212881 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-82f8d68d-5bb3-457f-aa49-ae1a1870eef2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:15.220032 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-82f8d68d-5bb3-457f-aa49-ae1a1870eef2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:15.220483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-82f8d68d-5bb3-457f-aa49-ae1a1870eef2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:15.221265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-82f8d68d-5bb3-457f-aa49-ae1a1870eef2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:15.221709 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-82f8d68d-5bb3-457f-aa49-ae1a1870eef2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:15.400938 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-82f8d68d-5bb3-457f-aa49-ae1a1870eef2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:15.409883 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-82f8d68d-5bb3-457f-aa49-ae1a1870eef2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.201086 Jun 16 18:57:15.410816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 71/157] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:15 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:15.964021 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-48a78490-fc5a-4520-b4d0-959fc9c7f828 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:15.965256 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-48a78490-fc5a-4520-b4d0-959fc9c7f828 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:15.971484 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-48a78490-fc5a-4520-b4d0-959fc9c7f828 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:15.971932 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-48a78490-fc5a-4520-b4d0-959fc9c7f828 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:15.972888 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-48a78490-fc5a-4520-b4d0-959fc9c7f828 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:15.973344 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-48a78490-fc5a-4520-b4d0-959fc9c7f828 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:16.008570 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-48a78490-fc5a-4520-b4d0-959fc9c7f828 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:16.009265 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-48a78490-fc5a-4520-b4d0-959fc9c7f828 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:16.010481 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-48a78490-fc5a-4520-b4d0-959fc9c7f828 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lazy-loading 'fault' on Instance uuid 544e6615-4246-45d4-bd9b-18a4ab137989 {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:57:16.051224 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-48a78490-fc5a-4520-b4d0-959fc9c7f828 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1052dda92d1a4597be43a7acdcd06905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f75a8c58e340a1bba335f7463c03a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:16.058437 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-48a78490-fc5a-4520-b4d0-959fc9c7f828 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 200 len: 1304 microversion: 2.1 time: 0.098267 Jun 16 18:57:16.059052 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 87/158] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:15 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:16.427969 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-53393765-1daf-422d-b354-954aecba516c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:16.428518 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-53393765-1daf-422d-b354-954aecba516c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:16.435833 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-53393765-1daf-422d-b354-954aecba516c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:16.436146 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-53393765-1daf-422d-b354-954aecba516c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:16.436947 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-53393765-1daf-422d-b354-954aecba516c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:16.437419 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-53393765-1daf-422d-b354-954aecba516c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:16.775496 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-53393765-1daf-422d-b354-954aecba516c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:16.779477 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-53393765-1daf-422d-b354-954aecba516c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.355436 Jun 16 18:57:16.780034 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 72/159] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:16 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:17.076140 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-80cced67-6d49-479d-9b2b-882ef16a14dc tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:17.076786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-80cced67-6d49-479d-9b2b-882ef16a14dc tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:17.082846 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-80cced67-6d49-479d-9b2b-882ef16a14dc tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:17.083290 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-80cced67-6d49-479d-9b2b-882ef16a14dc tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:17.084049 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-80cced67-6d49-479d-9b2b-882ef16a14dc tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:17.084513 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-80cced67-6d49-479d-9b2b-882ef16a14dc tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:17.098223 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-80cced67-6d49-479d-9b2b-882ef16a14dc tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] HTTP exception thrown: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-80cced67-6d49-479d-9b2b-882ef16a14dc tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Request method failure captured: Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 HTTP/1.1 Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq3zFqPHREukLCdByinkQ3_6DwKOgSoO3X-DaghVP444hyaX3m_XTzejTjcQZVhARxL9X63Y-6-7kctAC64EKzoSx-IiN9hqQ1vdEdriy0-YIL_Hwccn-bxfjNjGtQmat2w-2YtXVAul42hmcF-KNFUYNapkVgqY7DPgpNPCb7wFOX1A Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: 57f75a8c58e340a1bba335f7463c03a1 Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-DeleteServersTestJSON-965249925 Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 18:57:17.103165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 18:57:17.104632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57f75a8c58e340a1bba335f7463c03a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_57f75a8c58e340a1bba335f7463c03a1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57f75a8c58e340a1bba335f7463c03a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/57f75a8c58e340a1bba335f7463c03a1"}]}] Jun 16 18:57:17.104632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-DeleteServersTestJSON-965249925 Jun 16 18:57:17.104632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: 57f75a8c58e340a1bba335f7463c03a1 Jun 16 18:57:17.104632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-DeleteServersTestJSON-965249925 Jun 16 18:57:17.104632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-DeleteServersTestJSON-965249925-project Jun 16 18:57:17.104632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 18:57:17.104632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 18:57:17.104632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 1052dda92d1a4597be43a7acdcd06905 Jun 16 18:57:17.104632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-DeleteServersTestJSON-965249925-project Jun 16 18:57:17.104632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 18:57:17.104632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:17.104632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': '544e6615-4246-45d4-bd9b-18a4ab137989'} Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:57:17.106062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:17.107474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:17.108831 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-80cced67-6d49-479d-9b2b-882ef16a14dc tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Returning 404 to user: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:57:17.108831 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-80cced67-6d49-479d-9b2b-882ef16a14dc tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 404 len: 111 microversion: 2.1 time: 0.032432 Jun 16 18:57:17.108831 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 88/160] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:17 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:57:17.217549 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d6ec8acb-3b5e-494f-82b2-52ce031cb2e4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:17.219041 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d6ec8acb-3b5e-494f-82b2-52ce031cb2e4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:17.227252 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d6ec8acb-3b5e-494f-82b2-52ce031cb2e4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:17.227920 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d6ec8acb-3b5e-494f-82b2-52ce031cb2e4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:17.229074 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d6ec8acb-3b5e-494f-82b2-52ce031cb2e4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:17.229755 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d6ec8acb-3b5e-494f-82b2-52ce031cb2e4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:17.235512 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:17.244539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-d6ec8acb-3b5e-494f-82b2-52ce031cb2e4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] HTTP exception thrown: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d6ec8acb-3b5e-494f-82b2-52ce031cb2e4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Request method failure captured: Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989/os-volume_attachments HTTP/1.1 Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq3zFqPHREukLCdByinkQ3_6DwKOgSoO3X-DaghVP444hyaX3m_XTzejTjcQZVhARxL9X63Y-6-7kctAC64EKzoSx-IiN9hqQ1vdEdriy0-YIL_Hwccn-bxfjNjGtQmat2w-2YtXVAul42hmcF-KNFUYNapkVgqY7DPgpNPCb7wFOX1A Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: 57f75a8c58e340a1bba335f7463c03a1 Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-DeleteServersTestJSON-965249925 Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 18:57:17.249450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 18:57:17.250855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57f75a8c58e340a1bba335f7463c03a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_57f75a8c58e340a1bba335f7463c03a1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57f75a8c58e340a1bba335f7463c03a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/57f75a8c58e340a1bba335f7463c03a1"}]}] Jun 16 18:57:17.250855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-DeleteServersTestJSON-965249925 Jun 16 18:57:17.250855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: 57f75a8c58e340a1bba335f7463c03a1 Jun 16 18:57:17.250855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-DeleteServersTestJSON-965249925 Jun 16 18:57:17.250855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-DeleteServersTestJSON-965249925-project Jun 16 18:57:17.250855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 18:57:17.250855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 18:57:17.250855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 1052dda92d1a4597be43a7acdcd06905 Jun 16 18:57:17.250855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-DeleteServersTestJSON-965249925-project Jun 16 18:57:17.250855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 18:57:17.250855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:17.250855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'server_id': '544e6615-4246-45d4-bd9b-18a4ab137989'} Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:57:17.251667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:17.252944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:17.254239 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d6ec8acb-3b5e-494f-82b2-52ce031cb2e4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Returning 404 to user: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:57:17.254239 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d6ec8acb-3b5e-494f-82b2-52ce031cb2e4 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039788 Jun 16 18:57:17.254239 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 73/161] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 18:57:17 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:57:17.796701 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ca8782e5-ba64-4b80-b6b5-de8f05465187 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:17.797341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ca8782e5-ba64-4b80-b6b5-de8f05465187 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:17.803241 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ca8782e5-ba64-4b80-b6b5-de8f05465187 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:17.803688 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ca8782e5-ba64-4b80-b6b5-de8f05465187 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:17.804440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ca8782e5-ba64-4b80-b6b5-de8f05465187 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:17.804866 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ca8782e5-ba64-4b80-b6b5-de8f05465187 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:17.942758 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ca8782e5-ba64-4b80-b6b5-de8f05465187 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:17.950643 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ca8782e5-ba64-4b80-b6b5-de8f05465187 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.158388 Jun 16 18:57:17.951206 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 89/162] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:17 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:18.607329 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-277cf681-4756-49a4-858d-34b8a49f803c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:18.607917 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-277cf681-4756-49a4-858d-34b8a49f803c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:18.616345 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-277cf681-4756-49a4-858d-34b8a49f803c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:18.616793 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-277cf681-4756-49a4-858d-34b8a49f803c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:18.617741 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-277cf681-4756-49a4-858d-34b8a49f803c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:18.618163 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-277cf681-4756-49a4-858d-34b8a49f803c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:18.635337 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-277cf681-4756-49a4-858d-34b8a49f803c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] HTTP exception thrown: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-277cf681-4756-49a4-858d-34b8a49f803c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Request method failure captured: Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: DELETE /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 HTTP/1.1 Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq3zFqPHREukLCdByinkQ3_6DwKOgSoO3X-DaghVP444hyaX3m_XTzejTjcQZVhARxL9X63Y-6-7kctAC64EKzoSx-IiN9hqQ1vdEdriy0-YIL_Hwccn-bxfjNjGtQmat2w-2YtXVAul42hmcF-KNFUYNapkVgqY7DPgpNPCb7wFOX1A Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: 57f75a8c58e340a1bba335f7463c03a1 Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-DeleteServersTestJSON-965249925 Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 18:57:18.638606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 18:57:18.639864 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57f75a8c58e340a1bba335f7463c03a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_57f75a8c58e340a1bba335f7463c03a1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57f75a8c58e340a1bba335f7463c03a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/57f75a8c58e340a1bba335f7463c03a1"}]}] Jun 16 18:57:18.639864 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-DeleteServersTestJSON-965249925 Jun 16 18:57:18.639864 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: 57f75a8c58e340a1bba335f7463c03a1 Jun 16 18:57:18.639864 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-DeleteServersTestJSON-965249925 Jun 16 18:57:18.639864 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-DeleteServersTestJSON-965249925-project Jun 16 18:57:18.639864 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 18:57:18.639864 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 18:57:18.639864 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 1052dda92d1a4597be43a7acdcd06905 Jun 16 18:57:18.639864 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-DeleteServersTestJSON-965249925-project Jun 16 18:57:18.639864 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 18:57:18.639864 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:18.639864 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': '544e6615-4246-45d4-bd9b-18a4ab137989'} Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:57:18.640505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:18.645670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:18.646791 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-277cf681-4756-49a4-858d-34b8a49f803c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Returning 404 to user: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:57:18.646791 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-277cf681-4756-49a4-858d-34b8a49f803c tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "DELETE /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 404 len: 111 microversion: 2.1 time: 0.037093 Jun 16 18:57:18.646791 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 74/163] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 18:57:18 2022] DELETE /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:57:18.652835 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e77ced35-f035-4226-89ba-8abde2bb6822 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:18.653491 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e77ced35-f035-4226-89ba-8abde2bb6822 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] [instance: 544e6615-4246-45d4-bd9b-18a4ab137989] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:18.661692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e77ced35-f035-4226-89ba-8abde2bb6822 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:18.662140 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e77ced35-f035-4226-89ba-8abde2bb6822 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:18.662900 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e77ced35-f035-4226-89ba-8abde2bb6822 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:18.663336 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e77ced35-f035-4226-89ba-8abde2bb6822 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:18.818661 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-e77ced35-f035-4226-89ba-8abde2bb6822 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] HTTP exception thrown: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e77ced35-f035-4226-89ba-8abde2bb6822 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Request method failure captured: Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 HTTP/1.1 Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq3zFqPHREukLCdByinkQ3_6DwKOgSoO3X-DaghVP444hyaX3m_XTzejTjcQZVhARxL9X63Y-6-7kctAC64EKzoSx-IiN9hqQ1vdEdriy0-YIL_Hwccn-bxfjNjGtQmat2w-2YtXVAul42hmcF-KNFUYNapkVgqY7DPgpNPCb7wFOX1A Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: 57f75a8c58e340a1bba335f7463c03a1 Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-DeleteServersTestJSON-965249925 Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 18:57:18.820178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 18:57:18.821611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57f75a8c58e340a1bba335f7463c03a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_57f75a8c58e340a1bba335f7463c03a1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/57f75a8c58e340a1bba335f7463c03a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/57f75a8c58e340a1bba335f7463c03a1"}]}] Jun 16 18:57:18.821611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-DeleteServersTestJSON-965249925 Jun 16 18:57:18.821611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: 57f75a8c58e340a1bba335f7463c03a1 Jun 16 18:57:18.821611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-DeleteServersTestJSON-965249925 Jun 16 18:57:18.821611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-DeleteServersTestJSON-965249925-project Jun 16 18:57:18.821611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 18:57:18.821611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 18:57:18.821611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 1052dda92d1a4597be43a7acdcd06905 Jun 16 18:57:18.821611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-DeleteServersTestJSON-965249925-project Jun 16 18:57:18.821611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 18:57:18.821611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:18.821611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': '544e6615-4246-45d4-bd9b-18a4ab137989'} Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:57:18.822318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. Jun 16 18:57:18.823562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:18.824740 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e77ced35-f035-4226-89ba-8abde2bb6822 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] Returning 404 to user: Instance 544e6615-4246-45d4-bd9b-18a4ab137989 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:57:18.824740 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e77ced35-f035-4226-89ba-8abde2bb6822 tempest-DeleteServersTestJSON-965249925 tempest-DeleteServersTestJSON-965249925-project] 10.222.0.81 "GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989" status: 404 len: 111 microversion: 2.1 time: 0.173303 Jun 16 18:57:18.824740 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 90/164] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:18 2022] GET /compute/v2.1/servers/544e6615-4246-45d4-bd9b-18a4ab137989 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:57:18.975699 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a6e21f6c-2a84-4683-83db-3a725e89d80e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:18.975699 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a6e21f6c-2a84-4683-83db-3a725e89d80e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:18.977046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a6e21f6c-2a84-4683-83db-3a725e89d80e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:18.977507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a6e21f6c-2a84-4683-83db-3a725e89d80e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:18.978504 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a6e21f6c-2a84-4683-83db-3a725e89d80e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:18.979097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a6e21f6c-2a84-4683-83db-3a725e89d80e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:19.221863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a6e21f6c-2a84-4683-83db-3a725e89d80e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:19.235699 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a6e21f6c-2a84-4683-83db-3a725e89d80e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.271496 Jun 16 18:57:19.243793 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 75/165] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:18 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:20.252661 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-54dbefea-9250-465a-8343-039d1f93f83f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:20.253891 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-54dbefea-9250-465a-8343-039d1f93f83f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:20.260030 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-54dbefea-9250-465a-8343-039d1f93f83f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:20.260480 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-54dbefea-9250-465a-8343-039d1f93f83f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:20.261900 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-54dbefea-9250-465a-8343-039d1f93f83f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:20.262348 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-54dbefea-9250-465a-8343-039d1f93f83f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:20.673203 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-54dbefea-9250-465a-8343-039d1f93f83f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:20.680885 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-54dbefea-9250-465a-8343-039d1f93f83f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.432064 Jun 16 18:57:20.681825 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 91/166] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:20 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:21.700711 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-67eb3b85-6269-4742-8d57-889e114f3c1f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:21.701494 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-67eb3b85-6269-4742-8d57-889e114f3c1f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:21.710174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67eb3b85-6269-4742-8d57-889e114f3c1f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:21.710910 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67eb3b85-6269-4742-8d57-889e114f3c1f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:21.711815 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67eb3b85-6269-4742-8d57-889e114f3c1f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:21.712520 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67eb3b85-6269-4742-8d57-889e114f3c1f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:21.863747 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-67eb3b85-6269-4742-8d57-889e114f3c1f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:21.871582 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-67eb3b85-6269-4742-8d57-889e114f3c1f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.176981 Jun 16 18:57:21.872150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 76/167] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:21 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:22.889795 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b6b6504f-8fa3-4feb-9a5d-3813fdb43593 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:22.890407 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b6b6504f-8fa3-4feb-9a5d-3813fdb43593 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:22.897829 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b6b6504f-8fa3-4feb-9a5d-3813fdb43593 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:22.898463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b6b6504f-8fa3-4feb-9a5d-3813fdb43593 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:22.899523 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b6b6504f-8fa3-4feb-9a5d-3813fdb43593 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:22.899961 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b6b6504f-8fa3-4feb-9a5d-3813fdb43593 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:23.061004 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b6b6504f-8fa3-4feb-9a5d-3813fdb43593 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:23.069230 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b6b6504f-8fa3-4feb-9a5d-3813fdb43593 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.184793 Jun 16 18:57:23.069902 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 92/168] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:22 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:24.085863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-cce6b0b6-971b-4ea8-a137-c3ab03544f0a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:24.086498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-cce6b0b6-971b-4ea8-a137-c3ab03544f0a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:24.093284 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cce6b0b6-971b-4ea8-a137-c3ab03544f0a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:24.093744 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cce6b0b6-971b-4ea8-a137-c3ab03544f0a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:24.094523 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cce6b0b6-971b-4ea8-a137-c3ab03544f0a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:24.094974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cce6b0b6-971b-4ea8-a137-c3ab03544f0a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:24.261891 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-cce6b0b6-971b-4ea8-a137-c3ab03544f0a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:24.270954 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-cce6b0b6-971b-4ea8-a137-c3ab03544f0a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.187226 Jun 16 18:57:24.271551 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 77/169] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:24 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:25.288584 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5c8cf841-125a-49fd-ab1c-27f9d344cd8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:25.292650 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5c8cf841-125a-49fd-ab1c-27f9d344cd8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:25.295551 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-429dba84-21d7-4b1d-87eb-d92981d67deb tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Action: 'create', calling method: .version_select at 0x7f2014251dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-224450220"}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:57:25.307353 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5c8cf841-125a-49fd-ab1c-27f9d344cd8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:25.309964 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5c8cf841-125a-49fd-ab1c-27f9d344cd8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:25.311851 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5c8cf841-125a-49fd-ab1c-27f9d344cd8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:25.313526 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5c8cf841-125a-49fd-ab1c-27f9d344cd8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:25.481819 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5c8cf841-125a-49fd-ab1c-27f9d344cd8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:25.489560 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5c8cf841-125a-49fd-ab1c-27f9d344cd8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.205037 Jun 16 18:57:25.490283 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 78/170] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:25 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:26.003067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-429dba84-21d7-4b1d-87eb-d92981d67deb tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.839544 Jun 16 18:57:26.003759 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 93/171] 10.222.0.81 () {60 vars in 1154 bytes} [Thu Jun 16 18:57:25 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 841 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 18:57:26.015302 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-006fc8ae-4204-4835-9624-3562f1c2d0ab tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f20142a13a0>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:26.061530 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-006fc8ae-4204-4835-9624-3562f1c2d0ab tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b" status: 200 len: 344 microversion: 2.1 time: 0.050513 Jun 16 18:57:26.062103 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 79/172] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:26 2022] GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:26.506691 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5c30a656-4c9c-4256-96e3-3612b3ec302d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:26.507300 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5c30a656-4c9c-4256-96e3-3612b3ec302d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:26.513476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5c30a656-4c9c-4256-96e3-3612b3ec302d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:26.513924 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5c30a656-4c9c-4256-96e3-3612b3ec302d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:26.514680 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5c30a656-4c9c-4256-96e3-3612b3ec302d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:26.515115 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5c30a656-4c9c-4256-96e3-3612b3ec302d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:26.694943 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5c30a656-4c9c-4256-96e3-3612b3ec302d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:26.703300 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5c30a656-4c9c-4256-96e3-3612b3ec302d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.200458 Jun 16 18:57:26.703943 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 94/173] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:26 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:27.075769 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-aaa8c139-9664-4971-81f1-edf60e8c7cef tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f201420b8b0>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:27.129132 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-aaa8c139-9664-4971-81f1-edf60e8c7cef tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b" status: 200 len: 344 microversion: 2.1 time: 0.058476 Jun 16 18:57:27.129792 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 80/174] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:27 2022] GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:27.720026 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b0716b4b-16d5-4884-a4e9-5d7c1e3d5f5f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:27.720865 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b0716b4b-16d5-4884-a4e9-5d7c1e3d5f5f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:27.727223 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b0716b4b-16d5-4884-a4e9-5d7c1e3d5f5f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:27.727678 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b0716b4b-16d5-4884-a4e9-5d7c1e3d5f5f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:27.728554 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b0716b4b-16d5-4884-a4e9-5d7c1e3d5f5f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:27.729082 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b0716b4b-16d5-4884-a4e9-5d7c1e3d5f5f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:27.873996 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b0716b4b-16d5-4884-a4e9-5d7c1e3d5f5f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:27.882107 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b0716b4b-16d5-4884-a4e9-5d7c1e3d5f5f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.165923 Jun 16 18:57:27.882922 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 95/175] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:27 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:28.142903 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-485426f8-16c4-43ac-b4cf-d6e7669f3a96 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f2014310430>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:28.194329 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-485426f8-16c4-43ac-b4cf-d6e7669f3a96 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b" status: 200 len: 344 microversion: 2.1 time: 0.056341 Jun 16 18:57:28.194906 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 81/176] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:28 2022] GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:28.900027 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-be8b8f71-b9ba-4d31-a86e-76da0014055f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:28.900672 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-be8b8f71-b9ba-4d31-a86e-76da0014055f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:28.907385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-be8b8f71-b9ba-4d31-a86e-76da0014055f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:28.908059 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-be8b8f71-b9ba-4d31-a86e-76da0014055f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:28.908826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-be8b8f71-b9ba-4d31-a86e-76da0014055f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:28.909383 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-be8b8f71-b9ba-4d31-a86e-76da0014055f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:28.913635 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=100 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:29.132265 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-be8b8f71-b9ba-4d31-a86e-76da0014055f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:29.141754 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-be8b8f71-b9ba-4d31-a86e-76da0014055f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.245636 Jun 16 18:57:29.142341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 96/177] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:28 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:29.207331 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2e2e36d8-b629-43c8-b488-ed3c62fed0c1 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f2014201310>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:29.263034 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2e2e36d8-b629-43c8-b488-ed3c62fed0c1 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b" status: 200 len: 344 microversion: 2.1 time: 0.060064 Jun 16 18:57:29.263899 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 82/178] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:29 2022] GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:30.159484 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ab9b715d-8d7d-4303-a2d5-e62c91bb3c9f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:30.160096 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ab9b715d-8d7d-4303-a2d5-e62c91bb3c9f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:30.168771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ab9b715d-8d7d-4303-a2d5-e62c91bb3c9f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:30.170549 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ab9b715d-8d7d-4303-a2d5-e62c91bb3c9f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:30.170549 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ab9b715d-8d7d-4303-a2d5-e62c91bb3c9f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:30.170549 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ab9b715d-8d7d-4303-a2d5-e62c91bb3c9f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:30.276636 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-12e1afb6-a14e-4546-a6b8-266feb5fb0ac tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f20143114c0>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:30.329654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-12e1afb6-a14e-4546-a6b8-266feb5fb0ac tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b" status: 200 len: 345 microversion: 2.1 time: 0.057802 Jun 16 18:57:30.336626 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 83/179] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:30 2022] GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:30.342292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3c344430-453e-4530-94b0-0ee968da611e tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Action: 'create', calling method: .version_select at 0x7f20143100d0>, body: {"snapshot": {"volume_id": "25f33244-44d1-48c1-8d52-2b40dc84e08b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1981078328"}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:57:30.435713 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ab9b715d-8d7d-4303-a2d5-e62c91bb3c9f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:30.444069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ab9b715d-8d7d-4303-a2d5-e62c91bb3c9f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.288323 Jun 16 18:57:30.453638 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 97/180] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:30 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:30.834203 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3c344430-453e-4530-94b0-0ee968da611e tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.495616 Jun 16 18:57:30.835121 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 84/181] 10.222.0.81 () {60 vars in 1161 bytes} [Thu Jun 16 18:57:30 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:30.846627 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-16796b6e-bfbc-4fbc-9a23-421de1575b1b tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f20142195e0>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:30.878358 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-16796b6e-bfbc-4fbc-9a23-421de1575b1b tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5" status: 200 len: 287 microversion: 2.1 time: 0.035857 Jun 16 18:57:30.879011 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 98/182] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jun 16 18:57:30 2022] GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:30.889589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1952eea0-ad75-4ae5-9657-e9f067456b47 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f201430a5e0>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:30.918663 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1952eea0-ad75-4ae5-9657-e9f067456b47 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033515 Jun 16 18:57:30.919367 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 85/183] 10.222.0.81 () {58 vars in 1139 bytes} [Thu Jun 16 18:57:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:30.929735 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1a32f584-55bd-476b-a46b-18562e83880f tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f20142139d0>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:30.977905 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-1a32f584-55bd-476b-a46b-18562e83880f tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5" status: 200 len: 287 microversion: 2.1 time: 0.051865 Jun 16 18:57:30.978619 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 99/184] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jun 16 18:57:30 2022] GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:31.463124 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-58915d01-d789-43d4-9712-baea9a5cde7f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:31.464883 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-58915d01-d789-43d4-9712-baea9a5cde7f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:31.466958 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=40 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:31.474804 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-58915d01-d789-43d4-9712-baea9a5cde7f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:31.475520 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-58915d01-d789-43d4-9712-baea9a5cde7f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:31.476477 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-58915d01-d789-43d4-9712-baea9a5cde7f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:31.477071 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-58915d01-d789-43d4-9712-baea9a5cde7f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:31.636073 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-58915d01-d789-43d4-9712-baea9a5cde7f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:31.644010 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-58915d01-d789-43d4-9712-baea9a5cde7f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.187183 Jun 16 18:57:31.644576 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 86/185] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:31 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:31.994025 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-dcb686a3-baab-4bf3-bc72-fb546f71cd23 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f2014213430>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:32.094387 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-dcb686a3-baab-4bf3-bc72-fb546f71cd23 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5" status: 200 len: 287 microversion: 2.1 time: 0.105678 Jun 16 18:57:32.098728 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 100/186] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jun 16 18:57:31 2022] GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5 => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:32.662002 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-49d2975a-1f4e-4399-89ce-159ce5b71fc4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:32.663153 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-49d2975a-1f4e-4399-89ce-159ce5b71fc4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:32.669820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-49d2975a-1f4e-4399-89ce-159ce5b71fc4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:32.670271 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-49d2975a-1f4e-4399-89ce-159ce5b71fc4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:32.671063 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-49d2975a-1f4e-4399-89ce-159ce5b71fc4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:32.671577 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-49d2975a-1f4e-4399-89ce-159ce5b71fc4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:32.864594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-49d2975a-1f4e-4399-89ce-159ce5b71fc4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:32.872645 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-49d2975a-1f4e-4399-89ce-159ce5b71fc4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.215400 Jun 16 18:57:32.873350 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 87/187] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:32 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:33.107229 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-024cceb6-e934-4b61-b1cf-df9cee588cbb tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f2014501670>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:33.145021 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-024cceb6-e934-4b61-b1cf-df9cee588cbb tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5" status: 200 len: 287 microversion: 2.1 time: 0.042486 Jun 16 18:57:33.149958 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 101/188] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jun 16 18:57:33 2022] GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:33.890086 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b40ff87b-011a-401b-84c2-840c603978a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:33.890714 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b40ff87b-011a-401b-84c2-840c603978a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:33.905932 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b40ff87b-011a-401b-84c2-840c603978a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:33.907058 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b40ff87b-011a-401b-84c2-840c603978a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:33.908246 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b40ff87b-011a-401b-84c2-840c603978a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:33.909724 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b40ff87b-011a-401b-84c2-840c603978a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:34.080006 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b40ff87b-011a-401b-84c2-840c603978a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:34.088169 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b40ff87b-011a-401b-84c2-840c603978a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.202351 Jun 16 18:57:34.088868 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 88/189] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:33 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:34.156989 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9417a689-5b5f-42f0-a896-9f9e36577a0c tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f2014219b80>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:34.189940 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9417a689-5b5f-42f0-a896-9f9e36577a0c tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5" status: 200 len: 287 microversion: 2.1 time: 0.036757 Jun 16 18:57:34.191227 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 102/190] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jun 16 18:57:34 2022] GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:35.108043 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-aec6169c-e16b-4729-bbd4-d682326e32cb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:35.109171 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-aec6169c-e16b-4729-bbd4-d682326e32cb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:35.125359 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aec6169c-e16b-4729-bbd4-d682326e32cb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:35.126243 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aec6169c-e16b-4729-bbd4-d682326e32cb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:35.127393 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aec6169c-e16b-4729-bbd4-d682326e32cb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:35.128562 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aec6169c-e16b-4729-bbd4-d682326e32cb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:35.201312 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-bb986072-4899-4028-ad43-31c27a224399 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f2014213670>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:35.239330 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-bb986072-4899-4028-ad43-31c27a224399 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5" status: 200 len: 288 microversion: 2.1 time: 0.041844 Jun 16 18:57:35.240357 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 103/191] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jun 16 18:57:35 2022] GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5 => generated 288 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:57:35.257309 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-fde9a3de-dba1-424b-9aa2-f8836d477520 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f2014213160>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:35.435783 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-fde9a3de-dba1-424b-9aa2-f8836d477520 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "DELETE /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5" status: 202 len: 0 microversion: 2.1 time: 0.189525 Jun 16 18:57:35.436648 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 104/192] 10.222.0.81 () {58 vars in 1253 bytes} [Thu Jun 16 18:57:35 2022] DELETE /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:57:35.444809 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-2d73cac6-a6a0-419f-80e7-97a6d5f77e30 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f20142194c0>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:35.582134 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-2d73cac6-a6a0-419f-80e7-97a6d5f77e30 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5" status: 200 len: 287 microversion: 2.1 time: 0.141524 Jun 16 18:57:35.582730 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 105/193] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jun 16 18:57:35 2022] GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5 => generated 287 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:35.635938 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-aec6169c-e16b-4729-bbd4-d682326e32cb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:35.657606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-aec6169c-e16b-4729-bbd4-d682326e32cb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.555617 Jun 16 18:57:35.658497 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 89/194] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:35 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:36.595176 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-cd11be43-63c3-42d7-a2ba-edcb77b7d487 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f20144b54c0>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:36.641693 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-cd11be43-63c3-42d7-a2ba-edcb77b7d487 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] HTTP exception thrown: Snapshot 77291eb8-2576-4609-9425-00d0cfd1e0f5 could not be found. Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-cd11be43-63c3-42d7-a2ba-edcb77b7d487 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Request method failure captured: Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5 HTTP/1.1 Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq30VCI8dh_WcOOZTUdZqX_1Z-QcOajGNLlqXXV8Hz5H09NGU0KXBAqj0yiBt7KugtcrdcYpMUiOk0o5pAX50MhWP9FbvVjQ10k4Qy1WOuWPiG2efwYg39CMwweiyjQIRLiAChObrS18i-6cZwWBiU893ZuYDMsEPx9Y1xuMOtjKUXr8 Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: d135af04e85245efab72dc1f1f1cd245 Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1572754171 Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 18:57:36.642708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 18:57:36.643904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d135af04e85245efab72dc1f1f1cd245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d135af04e85245efab72dc1f1f1cd245", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d135af04e85245efab72dc1f1f1cd245"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d135af04e85245efab72dc1f1f1cd245"}]}] Jun 16 18:57:36.643904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1572754171 Jun 16 18:57:36.643904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: d135af04e85245efab72dc1f1f1cd245 Jun 16 18:57:36.643904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1572754171 Jun 16 18:57:36.643904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-VolumesSnapshotsTestJSON-1572754171-project Jun 16 18:57:36.643904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 18:57:36.643904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 18:57:36.643904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 85c4be4dc6104645a7662ce637444f35 Jun 16 18:57:36.643904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1572754171-project Jun 16 18:57:36.643904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: Jun 16 18:57:36.643904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Snapshot 77291eb8-2576-4609-9425-00d0cfd1e0f5 could not be found. Jun 16 18:57:36.643904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': '77291eb8-2576-4609-9425-00d0cfd1e0f5'} Jun 16 18:57:36.643904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 77291eb8-2576-4609-9425-00d0cfd1e0f5 could not be found. (HTTP 404) (Request-ID: req-f9894d86-857b-4123-ad86-26b02bd9f07a) Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:36.644621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:57:36.645656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 77291eb8-2576-4609-9425-00d0cfd1e0f5 could not be found. Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 18:57:36.647499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:57:36.649146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 77291eb8-2576-4609-9425-00d0cfd1e0f5 could not be found. Jun 16 18:57:36.649146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:36.649146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:36.649146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:36.649146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:36.649146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:36.649146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:36.649146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:57:36.649146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:57:36.649146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 77291eb8-2576-4609-9425-00d0cfd1e0f5 could not be found. Jun 16 18:57:36.649146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:36.650703 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-cd11be43-63c3-42d7-a2ba-edcb77b7d487 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Returning 404 to user: Snapshot 77291eb8-2576-4609-9425-00d0cfd1e0f5 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:57:36.652095 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-cd11be43-63c3-42d7-a2ba-edcb77b7d487 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5" status: 404 len: 111 microversion: 2.1 time: 0.060951 Jun 16 18:57:36.654730 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 106/195] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jun 16 18:57:36 2022] GET /compute/v2.1/os-snapshots/77291eb8-2576-4609-9425-00d0cfd1e0f5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:57:36.661622 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-dd56e768-b6a9-4bda-b8e0-8f3e173ec588 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f20143114c0>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:36.678516 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-70190185-b9d4-4027-8cc5-f9927cdb1217 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:36.679722 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-70190185-b9d4-4027-8cc5-f9927cdb1217 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:36.685219 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:36.690538 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-70190185-b9d4-4027-8cc5-f9927cdb1217 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:36.691192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-70190185-b9d4-4027-8cc5-f9927cdb1217 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:36.692200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-70190185-b9d4-4027-8cc5-f9927cdb1217 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:36.692746 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-70190185-b9d4-4027-8cc5-f9927cdb1217 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:36.896050 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-dd56e768-b6a9-4bda-b8e0-8f3e173ec588 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b" status: 202 len: 0 microversion: 2.1 time: 0.233924 Jun 16 18:57:36.896050 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 90/196] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jun 16 18:57:36 2022] DELETE /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:57:36.902683 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4ea8dfb2-4e0b-4d8e-b920-2479c8fb2dfd tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f20143818b0>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:36.982447 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4ea8dfb2-4e0b-4d8e-b920-2479c8fb2dfd tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b" status: 200 len: 344 microversion: 2.1 time: 0.082940 Jun 16 18:57:36.988474 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 91/197] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:36 2022] GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b => generated 344 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:37.009575 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-70190185-b9d4-4027-8cc5-f9927cdb1217 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:37.032032 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-70190185-b9d4-4027-8cc5-f9927cdb1217 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.361741 Jun 16 18:57:37.034094 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 107/198] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:36 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:37.996605 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-adb83a61-93f0-4522-8b9d-fbe0391fa351 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f201420bb80>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:38.052629 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-aee10c23-03a7-4f35-94c4-35666630563d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:38.055234 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-aee10c23-03a7-4f35-94c4-35666630563d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:38.070341 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-adb83a61-93f0-4522-8b9d-fbe0391fa351 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b" status: 200 len: 344 microversion: 2.1 time: 0.077141 Jun 16 18:57:38.072467 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 92/199] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:37 2022] GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b => generated 344 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:38.078039 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-aee10c23-03a7-4f35-94c4-35666630563d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:38.078665 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-aee10c23-03a7-4f35-94c4-35666630563d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:38.080318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-aee10c23-03a7-4f35-94c4-35666630563d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:38.081492 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-aee10c23-03a7-4f35-94c4-35666630563d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:38.252663 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-aee10c23-03a7-4f35-94c4-35666630563d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:38.262765 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-aee10c23-03a7-4f35-94c4-35666630563d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.215370 Jun 16 18:57:38.273728 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 108/200] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:38 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:57:39.085278 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ecb47b2a-01ff-4b0e-bbed-55759efe130a tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f2014381e50>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:39.142333 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ecb47b2a-01ff-4b0e-bbed-55759efe130a tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b" status: 200 len: 344 microversion: 2.1 time: 0.061145 Jun 16 18:57:39.148024 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 93/201] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:39 2022] GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:39.280985 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-46e11730-c376-422f-8619-afae3800f7c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:39.282395 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-46e11730-c376-422f-8619-afae3800f7c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:39.289560 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-46e11730-c376-422f-8619-afae3800f7c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:39.290329 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-46e11730-c376-422f-8619-afae3800f7c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:39.291392 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-46e11730-c376-422f-8619-afae3800f7c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:39.292221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-46e11730-c376-422f-8619-afae3800f7c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:39.452202 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-46e11730-c376-422f-8619-afae3800f7c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:39.459684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-46e11730-c376-422f-8619-afae3800f7c9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1521 microversion: 2.1 time: 0.183563 Jun 16 18:57:39.460252 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 109/202] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:39 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:40.155355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f8110fe8-b372-4dd5-8287-8b637903f0af tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f201420d3a0>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:40.224807 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f8110fe8-b372-4dd5-8287-8b637903f0af tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b" status: 200 len: 344 microversion: 2.1 time: 0.073414 Jun 16 18:57:40.225657 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 110/203] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:40 2022] GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:40.365550 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e658865d-1068-4f30-a8ad-5757061dacbf tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Action: 'create', calling method: .version_select at 0x7f2014201f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-653739164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFprAvOwqO+6N16PQgqMVkax5orUfweNS+Kdh8gutBHszXSo7J46hxIoBwzwMImwAXAl3ArUcJaYLuyyXhyjZiNVH7PlTW4NUpMxjj1WVF59OBq6S+L/Ahd/m/AFtNrvWA=="}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:57:40.376701 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-e658865d-1068-4f30-a8ad-5757061dacbf tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Getting quotas for project 5db8d64fab0e45ffbba87b1ae3b48703. Resources: {'key_pairs'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:57:40.380643 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-e658865d-1068-4f30-a8ad-5757061dacbf tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Getting quotas for user 0569765b6f07473fa07a5376b3677da8 and project 5db8d64fab0e45ffbba87b1ae3b48703. Resources: {'key_pairs'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:57:40.474749 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e658865d-1068-4f30-a8ad-5757061dacbf tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.384666 Jun 16 18:57:40.476014 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 94/204] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jun 16 18:57:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:57:40.479014 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-dc638e31-25f5-4940-b348-1bed97aab5d0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:40.482861 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-dc638e31-25f5-4940-b348-1bed97aab5d0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:40.491483 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dc638e31-25f5-4940-b348-1bed97aab5d0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:40.493460 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dc638e31-25f5-4940-b348-1bed97aab5d0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:40.494288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dc638e31-25f5-4940-b348-1bed97aab5d0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:40.494734 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dc638e31-25f5-4940-b348-1bed97aab5d0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:40.709371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-dc638e31-25f5-4940-b348-1bed97aab5d0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:40.719658 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-dc638e31-25f5-4940-b348-1bed97aab5d0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1501 microversion: 2.1 time: 0.244892 Jun 16 18:57:40.731182 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 111/205] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:40 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1501 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:40.742253 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2aadc8d2-414b-4676-80ec-0c81cd6b5e2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:40.743272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2aadc8d2-414b-4676-80ec-0c81cd6b5e2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:40.752568 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2aadc8d2-414b-4676-80ec-0c81cd6b5e2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:40.753389 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2aadc8d2-414b-4676-80ec-0c81cd6b5e2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:40.754539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2aadc8d2-414b-4676-80ec-0c81cd6b5e2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:40.755281 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2aadc8d2-414b-4676-80ec-0c81cd6b5e2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:40.959991 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2aadc8d2-414b-4676-80ec-0c81cd6b5e2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:40.968011 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2aadc8d2-414b-4676-80ec-0c81cd6b5e2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1514 microversion: 2.1 time: 0.230499 Jun 16 18:57:40.968582 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 95/206] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:40 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:41.238052 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0162588c-96ad-46cb-9e6a-7cef9ffe3fcc tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f2014501dc0>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:41.266223 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-0162588c-96ad-46cb-9e6a-7cef9ffe3fcc tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] HTTP exception thrown: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0162588c-96ad-46cb-9e6a-7cef9ffe3fcc tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Request method failure captured: Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b HTTP/1.1 Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq30VCI8dh_WcOOZTUdZqX_1Z-QcOajGNLlqXXV8Hz5H09NGU0KXBAqj0yiBt7KugtcrdcYpMUiOk0o5pAX50MhWP9FbvVjQ10k4Qy1WOuWPiG2efwYg39CMwweiyjQIRLiAChObrS18i-6cZwWBiU893ZuYDMsEPx9Y1xuMOtjKUXr8 Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: d135af04e85245efab72dc1f1f1cd245 Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1572754171 Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 18:57:41.268486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 18:57:41.269966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d135af04e85245efab72dc1f1f1cd245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d135af04e85245efab72dc1f1f1cd245", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d135af04e85245efab72dc1f1f1cd245"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d135af04e85245efab72dc1f1f1cd245"}]}] Jun 16 18:57:41.269966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1572754171 Jun 16 18:57:41.269966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: d135af04e85245efab72dc1f1f1cd245 Jun 16 18:57:41.269966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1572754171 Jun 16 18:57:41.269966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-VolumesSnapshotsTestJSON-1572754171-project Jun 16 18:57:41.269966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 18:57:41.269966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 18:57:41.269966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 85c4be4dc6104645a7662ce637444f35 Jun 16 18:57:41.269966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1572754171-project Jun 16 18:57:41.269966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: Jun 16 18:57:41.269966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. Jun 16 18:57:41.269966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': '25f33244-44d1-48c1-8d52-2b40dc84e08b'} Jun 16 18:57:41.269966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. (HTTP 404) (Request-ID: req-734bfa44-64e6-4b76-bdcb-f22af92ecc00) Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:41.270840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:57:41.272055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:57:41.273371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:57:41.277718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. Jun 16 18:57:41.277718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.277718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:41.277718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.277718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:41.277718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:41.277718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:41.277718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:57:41.277718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:57:41.277718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. Jun 16 18:57:41.277718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.277718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0162588c-96ad-46cb-9e6a-7cef9ffe3fcc tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Returning 404 to user: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:57:41.277718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0162588c-96ad-46cb-9e6a-7cef9ffe3fcc tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b" status: 404 len: 109 microversion: 2.1 time: 0.041263 Jun 16 18:57:41.277718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 112/207] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:41 2022] GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:57:41.286066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-803ceb7c-9dea-4cd9-b169-0acedd295d12 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f2014321b80>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:41.317830 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-803ceb7c-9dea-4cd9-b169-0acedd295d12 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] HTTP exception thrown: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-803ceb7c-9dea-4cd9-b169-0acedd295d12 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Request method failure captured: Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: DELETE /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b HTTP/1.1 Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq30VCI8dh_WcOOZTUdZqX_1Z-QcOajGNLlqXXV8Hz5H09NGU0KXBAqj0yiBt7KugtcrdcYpMUiOk0o5pAX50MhWP9FbvVjQ10k4Qy1WOuWPiG2efwYg39CMwweiyjQIRLiAChObrS18i-6cZwWBiU893ZuYDMsEPx9Y1xuMOtjKUXr8 Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: d135af04e85245efab72dc1f1f1cd245 Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1572754171 Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 18:57:41.321507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 18:57:41.322939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d135af04e85245efab72dc1f1f1cd245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d135af04e85245efab72dc1f1f1cd245", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d135af04e85245efab72dc1f1f1cd245"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d135af04e85245efab72dc1f1f1cd245"}]}] Jun 16 18:57:41.322939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1572754171 Jun 16 18:57:41.322939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: d135af04e85245efab72dc1f1f1cd245 Jun 16 18:57:41.322939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1572754171 Jun 16 18:57:41.322939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-VolumesSnapshotsTestJSON-1572754171-project Jun 16 18:57:41.322939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 18:57:41.322939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 18:57:41.322939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 85c4be4dc6104645a7662ce637444f35 Jun 16 18:57:41.322939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1572754171-project Jun 16 18:57:41.322939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: Jun 16 18:57:41.322939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. Jun 16 18:57:41.322939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': '25f33244-44d1-48c1-8d52-2b40dc84e08b'} Jun 16 18:57:41.322939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. (HTTP 404) (Request-ID: req-a7a734d7-a92c-4341-9aa9-1bae41025218) Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:41.323828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 18:57:41.325174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 18:57:41.326405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:57:41.327703 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. Jun 16 18:57:41.327703 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.327703 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:41.327703 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.327703 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:41.327703 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:41.327703 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:41.327703 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:57:41.327703 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:57:41.327703 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. Jun 16 18:57:41.327703 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.329882 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-803ceb7c-9dea-4cd9-b169-0acedd295d12 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Returning 404 to user: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:57:41.330834 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-803ceb7c-9dea-4cd9-b169-0acedd295d12 tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b" status: 404 len: 109 microversion: 2.1 time: 0.048610 Jun 16 18:57:41.331394 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 96/208] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jun 16 18:57:41 2022] DELETE /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:57:41.340158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6c990975-23fb-40c6-a0b5-e00827a4c51d tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Calling method '.version_select at 0x7f20141a1430>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-6c990975-23fb-40c6-a0b5-e00827a4c51d tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] HTTP exception thrown: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6c990975-23fb-40c6-a0b5-e00827a4c51d tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Request method failure captured: Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b HTTP/1.1 Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq30VCI8dh_WcOOZTUdZqX_1Z-QcOajGNLlqXXV8Hz5H09NGU0KXBAqj0yiBt7KugtcrdcYpMUiOk0o5pAX50MhWP9FbvVjQ10k4Qy1WOuWPiG2efwYg39CMwweiyjQIRLiAChObrS18i-6cZwWBiU893ZuYDMsEPx9Y1xuMOtjKUXr8 Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: d135af04e85245efab72dc1f1f1cd245 Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1572754171 Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 18:57:41.377923 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 18:57:41.379422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d135af04e85245efab72dc1f1f1cd245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_d135af04e85245efab72dc1f1f1cd245", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/d135af04e85245efab72dc1f1f1cd245"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/d135af04e85245efab72dc1f1f1cd245"}]}] Jun 16 18:57:41.379422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1572754171 Jun 16 18:57:41.379422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: d135af04e85245efab72dc1f1f1cd245 Jun 16 18:57:41.379422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1572754171 Jun 16 18:57:41.379422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-VolumesSnapshotsTestJSON-1572754171-project Jun 16 18:57:41.379422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 18:57:41.379422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 18:57:41.379422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 85c4be4dc6104645a7662ce637444f35 Jun 16 18:57:41.379422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1572754171-project Jun 16 18:57:41.379422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: Jun 16 18:57:41.379422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. Jun 16 18:57:41.379422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': '25f33244-44d1-48c1-8d52-2b40dc84e08b'} Jun 16 18:57:41.379422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. (HTTP 404) (Request-ID: req-0d2fd5f3-3400-4019-b6a3-1e6f719ce49b) Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:41.380791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:57:41.381992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:57:41.383714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:57:41.384957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. Jun 16 18:57:41.384957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.384957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:41.384957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.384957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:41.384957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:41.384957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:41.384957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:57:41.384957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:57:41.384957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. Jun 16 18:57:41.384957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:57:41.384957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6c990975-23fb-40c6-a0b5-e00827a4c51d tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] Returning 404 to user: Volume 25f33244-44d1-48c1-8d52-2b40dc84e08b could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:57:41.384957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6c990975-23fb-40c6-a0b5-e00827a4c51d tempest-VolumesSnapshotsTestJSON-1572754171 tempest-VolumesSnapshotsTestJSON-1572754171-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b" status: 404 len: 109 microversion: 2.1 time: 0.040409 Jun 16 18:57:41.384957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 113/209] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:41 2022] GET /compute/v2.1/os-volumes/25f33244-44d1-48c1-8d52-2b40dc84e08b => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:57:42.733386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4826c250-b536-4ebe-b303-4f4abb682f2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:57:42.734243 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4826c250-b536-4ebe-b303-4f4abb682f2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:42.744225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4826c250-b536-4ebe-b303-4f4abb682f2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:42.744760 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4826c250-b536-4ebe-b303-4f4abb682f2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:42.745560 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4826c250-b536-4ebe-b303-4f4abb682f2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:42.746031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4826c250-b536-4ebe-b303-4f4abb682f2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:42.780160 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.objects.instance [None req-4826c250-b536-4ebe-b303-4f4abb682f2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lazy-loading 'flavor' on Instance uuid 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b {{(pid=130230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:57:43.284384 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4826c250-b536-4ebe-b303-4f4abb682f2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "POST /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b/action" status: 200 len: 32 microversion: 2.1 time: 0.557642 Jun 16 18:57:43.285418 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 97/210] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jun 16 18:57:42 2022] POST /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b/action => generated 32 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 18:57:43.298025 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-511a06f3-7ebb-44b7-a9ae-bd9c613599a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:43.298663 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-511a06f3-7ebb-44b7-a9ae-bd9c613599a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:43.317505 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-511a06f3-7ebb-44b7-a9ae-bd9c613599a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:43.318141 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-511a06f3-7ebb-44b7-a9ae-bd9c613599a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:43.319564 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-511a06f3-7ebb-44b7-a9ae-bd9c613599a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:43.320158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-511a06f3-7ebb-44b7-a9ae-bd9c613599a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:43.523860 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-511a06f3-7ebb-44b7-a9ae-bd9c613599a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:43.536659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-511a06f3-7ebb-44b7-a9ae-bd9c613599a2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.241491 Jun 16 18:57:43.551541 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 114/211] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:43 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:44.559571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-86fe186a-1ac5-4f0f-8ef5-1eb769d96773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:44.560552 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-86fe186a-1ac5-4f0f-8ef5-1eb769d96773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:44.566416 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-666b89de-747b-407c-9720-bb3ee2a9fbdd tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] Action: 'create', calling method: .version_select at 0x7f20142a18b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1426354983", "metadata": {"Type": "work"}}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:57:44.574093 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-86fe186a-1ac5-4f0f-8ef5-1eb769d96773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:44.574553 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-86fe186a-1ac5-4f0f-8ef5-1eb769d96773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:44.587426 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-86fe186a-1ac5-4f0f-8ef5-1eb769d96773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:44.587426 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-86fe186a-1ac5-4f0f-8ef5-1eb769d96773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:44.858362 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-86fe186a-1ac5-4f0f-8ef5-1eb769d96773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:44.865868 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-86fe186a-1ac5-4f0f-8ef5-1eb769d96773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.310803 Jun 16 18:57:44.866893 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 115/212] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:44 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:45.457290 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-666b89de-747b-407c-9720-bb3ee2a9fbdd tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.073569 Jun 16 18:57:45.458673 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 98/213] 10.222.0.81 () {60 vars in 1155 bytes} [Thu Jun 16 18:57:44 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1076 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 18:57:45.473454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8519b5d3-e30b-4913-978e-58f8983dccc0 tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] Calling method '.version_select at 0x7f20142190d0>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:45.537584 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8519b5d3-e30b-4913-978e-58f8983dccc0 tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/c8f3c4cc-a698-43be-b8af-090bd5c04b81" status: 200 len: 353 microversion: 2.1 time: 0.069119 Jun 16 18:57:45.538496 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 116/214] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:45 2022] GET /compute/v2.1/os-volumes/c8f3c4cc-a698-43be-b8af-090bd5c04b81 => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:45.883023 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-513ea9f6-8d1a-4088-afb1-2962654ac0f0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:45.883755 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-513ea9f6-8d1a-4088-afb1-2962654ac0f0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:45.891200 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-513ea9f6-8d1a-4088-afb1-2962654ac0f0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:45.891724 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-513ea9f6-8d1a-4088-afb1-2962654ac0f0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:45.892509 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-513ea9f6-8d1a-4088-afb1-2962654ac0f0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:45.892949 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-513ea9f6-8d1a-4088-afb1-2962654ac0f0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:46.041698 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-513ea9f6-8d1a-4088-afb1-2962654ac0f0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:46.050501 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-513ea9f6-8d1a-4088-afb1-2962654ac0f0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.170990 Jun 16 18:57:46.051083 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 99/215] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:45 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:46.550119 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-281bbfad-8f6e-42ac-97a2-705e4b715af9 tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] Calling method '.version_select at 0x7f20141a1550>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:46.602065 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-281bbfad-8f6e-42ac-97a2-705e4b715af9 tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/c8f3c4cc-a698-43be-b8af-090bd5c04b81" status: 200 len: 354 microversion: 2.1 time: 0.055722 Jun 16 18:57:46.602805 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 117/216] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:46 2022] GET /compute/v2.1/os-volumes/c8f3c4cc-a698-43be-b8af-090bd5c04b81 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:46.613981 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-0666ee9a-f301-43a0-bc03-6c90071bdacd tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] Calling method '.version_select at 0x7f20142a1700>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:46.670317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-0666ee9a-f301-43a0-bc03-6c90071bdacd tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/c8f3c4cc-a698-43be-b8af-090bd5c04b81" status: 200 len: 354 microversion: 2.1 time: 0.059991 Jun 16 18:57:46.670962 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 100/217] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:46 2022] GET /compute/v2.1/os-volumes/c8f3c4cc-a698-43be-b8af-090bd5c04b81 => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:46.683407 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8f3b981b-94b7-406f-bf59-9daadf8e0d0a tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] Calling method '.version_select at 0x7f20141a1940>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:46.936502 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8f3b981b-94b7-406f-bf59-9daadf8e0d0a tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/c8f3c4cc-a698-43be-b8af-090bd5c04b81" status: 202 len: 0 microversion: 2.1 time: 0.257634 Jun 16 18:57:46.937137 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 118/218] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jun 16 18:57:46 2022] DELETE /compute/v2.1/os-volumes/c8f3c4cc-a698-43be-b8af-090bd5c04b81 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:57:46.944910 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-7359ec3e-8aaa-4db4-b5c2-bdd230bdb758 tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] Calling method '.version_select at 0x7f201449f670>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:46.996340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-7359ec3e-8aaa-4db4-b5c2-bdd230bdb758 tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/c8f3c4cc-a698-43be-b8af-090bd5c04b81" status: 200 len: 353 microversion: 2.1 time: 0.055115 Jun 16 18:57:46.997172 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 101/219] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:46 2022] GET /compute/v2.1/os-volumes/c8f3c4cc-a698-43be-b8af-090bd5c04b81 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:57:47.070966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5a74f57f-f525-459d-89ad-1991518f4301 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:47.071543 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5a74f57f-f525-459d-89ad-1991518f4301 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:47.079182 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5a74f57f-f525-459d-89ad-1991518f4301 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:47.079636 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5a74f57f-f525-459d-89ad-1991518f4301 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:47.080420 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5a74f57f-f525-459d-89ad-1991518f4301 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:47.080857 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5a74f57f-f525-459d-89ad-1991518f4301 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:47.263361 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5a74f57f-f525-459d-89ad-1991518f4301 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:47.271267 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5a74f57f-f525-459d-89ad-1991518f4301 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.204132 Jun 16 18:57:47.271866 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 119/220] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:47 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:48.007787 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3fdd5659-e9e1-4779-945f-7753bea2a386 tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] Calling method '.version_select at 0x7f20144c0a60>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:48.040197 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-3fdd5659-e9e1-4779-945f-7753bea2a386 tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] HTTP exception thrown: Volume c8f3c4cc-a698-43be-b8af-090bd5c04b81 could not be found. Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3fdd5659-e9e1-4779-945f-7753bea2a386 tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] Request method failure captured: Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/os-volumes/c8f3c4cc-a698-43be-b8af-090bd5c04b81 HTTP/1.1 Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq30owZZkoi2Io-NTX6WaEA2GLVNSpwt-wkRlG8S3yxrraVAiQBKWsqZgDuHnX81NlkhM-bGnWhpVBR3p0r54qhDIpTyl7TlE13oYJgf8MrqhgH0bF5qrDpRt1PpiMSPM0dMcHWaUy4CALdFZ_ijM1oODaPkMBGVjRtrefPYUqbALhP8 Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: 0b2bae632b624df0a2bedfad6548e423 Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-VolumesGetTestJSON-366096070 Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 18:57:48.042534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 18:57:48.044057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b2bae632b624df0a2bedfad6548e423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0b2bae632b624df0a2bedfad6548e423", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b2bae632b624df0a2bedfad6548e423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0b2bae632b624df0a2bedfad6548e423"}]}] Jun 16 18:57:48.044057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-VolumesGetTestJSON-366096070 Jun 16 18:57:48.044057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: 0b2bae632b624df0a2bedfad6548e423 Jun 16 18:57:48.044057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-VolumesGetTestJSON-366096070 Jun 16 18:57:48.044057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-VolumesGetTestJSON-366096070-project Jun 16 18:57:48.044057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 18:57:48.044057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 18:57:48.044057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 4c35fa0c8e3b42efbe30af614b4c6db1 Jun 16 18:57:48.044057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-VolumesGetTestJSON-366096070-project Jun 16 18:57:48.044057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: Jun 16 18:57:48.044057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Volume c8f3c4cc-a698-43be-b8af-090bd5c04b81 could not be found. Jun 16 18:57:48.044057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': 'c8f3c4cc-a698-43be-b8af-090bd5c04b81'} Jun 16 18:57:48.044057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c8f3c4cc-a698-43be-b8af-090bd5c04b81 could not be found. (HTTP 404) (Request-ID: req-cd5d35e6-81c6-4f56-9aed-3440b7f6578e) Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:48.044946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:57:48.046272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c8f3c4cc-a698-43be-b8af-090bd5c04b81 could not be found. Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:57:48.047483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:57:48.048718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c8f3c4cc-a698-43be-b8af-090bd5c04b81 could not be found. Jun 16 18:57:48.048718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:48.048718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:57:48.048718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:48.048718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:57:48.048718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:57:48.048718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:57:48.048718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:57:48.048718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:57:48.048718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c8f3c4cc-a698-43be-b8af-090bd5c04b81 could not be found. Jun 16 18:57:48.048718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:57:48.050719 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3fdd5659-e9e1-4779-945f-7753bea2a386 tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] Returning 404 to user: Volume c8f3c4cc-a698-43be-b8af-090bd5c04b81 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:57:48.052746 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3fdd5659-e9e1-4779-945f-7753bea2a386 tempest-VolumesGetTestJSON-366096070 tempest-VolumesGetTestJSON-366096070-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/c8f3c4cc-a698-43be-b8af-090bd5c04b81" status: 404 len: 109 microversion: 2.1 time: 0.048531 Jun 16 18:57:48.053485 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 102/221] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:48 2022] GET /compute/v2.1/os-volumes/c8f3c4cc-a698-43be-b8af-090bd5c04b81 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:57:48.289794 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-68864926-9d67-4f58-a7f0-1eb1eec50409 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:48.290397 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-68864926-9d67-4f58-a7f0-1eb1eec50409 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:48.296979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-68864926-9d67-4f58-a7f0-1eb1eec50409 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:48.297645 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-68864926-9d67-4f58-a7f0-1eb1eec50409 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:48.298436 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-68864926-9d67-4f58-a7f0-1eb1eec50409 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:48.298866 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-68864926-9d67-4f58-a7f0-1eb1eec50409 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:48.435176 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-68864926-9d67-4f58-a7f0-1eb1eec50409 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:48.442778 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-68864926-9d67-4f58-a7f0-1eb1eec50409 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.156888 Jun 16 18:57:48.443345 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 120/222] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:48 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:49.460665 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-715cdef1-d832-42e8-8c3f-ee549afcb276 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:49.462263 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-715cdef1-d832-42e8-8c3f-ee549afcb276 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:49.469765 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-715cdef1-d832-42e8-8c3f-ee549afcb276 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:49.470792 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-715cdef1-d832-42e8-8c3f-ee549afcb276 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:49.476408 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-715cdef1-d832-42e8-8c3f-ee549afcb276 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:49.476408 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-715cdef1-d832-42e8-8c3f-ee549afcb276 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:49.505992 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:49.714305 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-715cdef1-d832-42e8-8c3f-ee549afcb276 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:49.723634 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-715cdef1-d832-42e8-8c3f-ee549afcb276 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.267596 Jun 16 18:57:49.724501 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 103/223] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:49 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:50.743761 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-010365c7-bb6f-4a9f-8e78-9fbd6dcd4512 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:50.746125 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-010365c7-bb6f-4a9f-8e78-9fbd6dcd4512 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:50.752511 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-010365c7-bb6f-4a9f-8e78-9fbd6dcd4512 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:50.753713 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-010365c7-bb6f-4a9f-8e78-9fbd6dcd4512 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:50.754619 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-010365c7-bb6f-4a9f-8e78-9fbd6dcd4512 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:50.755450 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-010365c7-bb6f-4a9f-8e78-9fbd6dcd4512 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:50.921450 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-010365c7-bb6f-4a9f-8e78-9fbd6dcd4512 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:50.930788 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-010365c7-bb6f-4a9f-8e78-9fbd6dcd4512 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.193070 Jun 16 18:57:50.931747 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 121/224] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:50 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:51.948420 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-efb664a3-83db-41b7-9e0d-e360a50f83fd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:51.949291 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-efb664a3-83db-41b7-9e0d-e360a50f83fd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:51.956295 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=4 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:51.958346 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-efb664a3-83db-41b7-9e0d-e360a50f83fd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:51.958805 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-efb664a3-83db-41b7-9e0d-e360a50f83fd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:51.959593 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-efb664a3-83db-41b7-9e0d-e360a50f83fd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:51.960035 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-efb664a3-83db-41b7-9e0d-e360a50f83fd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:52.122727 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-efb664a3-83db-41b7-9e0d-e360a50f83fd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:52.130602 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-efb664a3-83db-41b7-9e0d-e360a50f83fd tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.186424 Jun 16 18:57:52.131423 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 104/225] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:51 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:52.851733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-813651230", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "networks": [{"uuid": "1cba00b2-5236-4b98-9847-76f93e5270f2"}]}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:57:52.904266 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.network.neutron [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] validate_networks() for [('1cba00b2-5236-4b98-9847-76f93e5270f2', None, None, None, None, None)] {{(pid=130229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:57:53.148905 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b42a22fc-7f0e-4f71-8ea4-e0e748483384 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:53.150369 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b42a22fc-7f0e-4f71-8ea4-e0e748483384 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:53.172829 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b42a22fc-7f0e-4f71-8ea4-e0e748483384 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:53.173823 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b42a22fc-7f0e-4f71-8ea4-e0e748483384 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:53.174555 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b42a22fc-7f0e-4f71-8ea4-e0e748483384 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:53.174988 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b42a22fc-7f0e-4f71-8ea4-e0e748483384 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:53.608905 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Flavor limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:57:53.609339 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Image limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:57:53.609813 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Flavor pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:57:53.610223 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Image pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:57:53.610635 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:57:53.621208 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:53.623885 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:53.623885 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:53.623885 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:53.642578 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Getting quotas for project e16a74b1bc56455b8f60bfc28bc94afb. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:57:53.645695 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b42a22fc-7f0e-4f71-8ea4-e0e748483384 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:53.646654 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Getting quotas for user eed09fa6ecf14635949417f19c8a3af0 and project e16a74b1bc56455b8f60bfc28bc94afb. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:57:53.655141 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b42a22fc-7f0e-4f71-8ea4-e0e748483384 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.510402 Jun 16 18:57:53.656350 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 105/226] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:53 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:53.659581 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Going to run 1 instances... {{(pid=130229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:57:53.660991 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-817f22cb-7215-4b43-b7f1-931d001d209f tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] Calling method '.version_select at 0x7f2014353b80>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:53.661875 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:57:53.712087 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-817f22cb-7215-4b43-b7f1-931d001d209f tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/20842443-0bea-42e1-afb4-ef12490c1f90" status: 200 len: 351 microversion: 2.1 time: 0.054537 Jun 16 18:57:53.712652 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 106/227] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:53 2022] GET /compute/v2.1/os-volumes/20842443-0bea-42e1-afb4-ef12490c1f90 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:53.770973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4b1ecc99-5bb8-4fd7-84e9-6721522e5ddc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.923359 Jun 16 18:57:53.771719 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 122/228] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 18:57:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:57:53.787471 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-88c26e7f-74ec-474a-96db-bb074c18bdfa tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:53.790324 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-88c26e7f-74ec-474a-96db-bb074c18bdfa tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:53.867411 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-88c26e7f-74ec-474a-96db-bb074c18bdfa tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:53.877679 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-88c26e7f-74ec-474a-96db-bb074c18bdfa tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1218 microversion: 2.1 time: 0.099028 Jun 16 18:57:53.885733 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 107/229] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:53 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:57:54.690066 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e5a83c63-1134-4c37-9078-4d931fac34a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:54.690066 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e5a83c63-1134-4c37-9078-4d931fac34a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:54.690066 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e5a83c63-1134-4c37-9078-4d931fac34a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:54.690066 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e5a83c63-1134-4c37-9078-4d931fac34a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:54.691238 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e5a83c63-1134-4c37-9078-4d931fac34a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:54.691238 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e5a83c63-1134-4c37-9078-4d931fac34a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:54.822659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e5a83c63-1134-4c37-9078-4d931fac34a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:54.831061 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e5a83c63-1134-4c37-9078-4d931fac34a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.162981 Jun 16 18:57:54.831623 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 123/230] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:54 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:54.895078 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-7537343a-bd4b-4e41-9a69-d42cc956a4d8 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:54.895625 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-7537343a-bd4b-4e41-9a69-d42cc956a4d8 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:54.956265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-7537343a-bd4b-4e41-9a69-d42cc956a4d8 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:54.963144 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-7537343a-bd4b-4e41-9a69-d42cc956a4d8 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1218 microversion: 2.1 time: 0.072004 Jun 16 18:57:54.963741 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 108/231] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:54 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:55.444209 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-67e6135c-a0a4-4054-a522-7ae79d9875b2 tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] Calling method '.version_select at 0x7f20141a19d0>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:55.496533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-67e6135c-a0a4-4054-a522-7ae79d9875b2 tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/a6748398-9ab5-4c78-b21f-4695619181f6" status: 200 len: 351 microversion: 2.1 time: 0.058141 Jun 16 18:57:55.497335 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 124/232] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:55 2022] GET /compute/v2.1/os-volumes/a6748398-9ab5-4c78-b21f-4695619181f6 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:55.848373 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e6085244-23ea-4f18-bfcf-54bf0ceadf28 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:55.849097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e6085244-23ea-4f18-bfcf-54bf0ceadf28 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:55.869081 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e6085244-23ea-4f18-bfcf-54bf0ceadf28 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:55.869081 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e6085244-23ea-4f18-bfcf-54bf0ceadf28 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:55.869081 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e6085244-23ea-4f18-bfcf-54bf0ceadf28 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:55.869081 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e6085244-23ea-4f18-bfcf-54bf0ceadf28 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:55.982375 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b9c6e094-5c5e-4f26-ac31-dd1bd21728ff tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:55.991892 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b9c6e094-5c5e-4f26-ac31-dd1bd21728ff tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:55.991892 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b9c6e094-5c5e-4f26-ac31-dd1bd21728ff tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:55.992723 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b9c6e094-5c5e-4f26-ac31-dd1bd21728ff tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:55.996535 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b9c6e094-5c5e-4f26-ac31-dd1bd21728ff tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:55.997205 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b9c6e094-5c5e-4f26-ac31-dd1bd21728ff tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:56.133413 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b9c6e094-5c5e-4f26-ac31-dd1bd21728ff tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:56.142355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b9c6e094-5c5e-4f26-ac31-dd1bd21728ff tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1222 microversion: 2.1 time: 0.165730 Jun 16 18:57:56.143648 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 125/233] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:55 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1222 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:57:56.196747 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e6085244-23ea-4f18-bfcf-54bf0ceadf28 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:56.204549 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e6085244-23ea-4f18-bfcf-54bf0ceadf28 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.360461 Jun 16 18:57:56.207843 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 109/234] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:55 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:57.159874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b978f7a3-d343-4320-a400-819471036b3c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:57.163489 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b978f7a3-d343-4320-a400-819471036b3c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:57.166193 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b978f7a3-d343-4320-a400-819471036b3c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:57.166636 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b978f7a3-d343-4320-a400-819471036b3c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:57.167440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b978f7a3-d343-4320-a400-819471036b3c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:57.168162 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b978f7a3-d343-4320-a400-819471036b3c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:57.223214 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-602315d6-c75d-48fb-9160-8265a8f1b281 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:57.223916 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-602315d6-c75d-48fb-9160-8265a8f1b281 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:57.230615 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-602315d6-c75d-48fb-9160-8265a8f1b281 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:57.231661 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-602315d6-c75d-48fb-9160-8265a8f1b281 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:57.232662 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-602315d6-c75d-48fb-9160-8265a8f1b281 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:57.233295 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-602315d6-c75d-48fb-9160-8265a8f1b281 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:57.242936 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b978f7a3-d343-4320-a400-819471036b3c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:57.257473 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b978f7a3-d343-4320-a400-819471036b3c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1222 microversion: 2.1 time: 0.100228 Jun 16 18:57:57.274105 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 126/235] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:57 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:57.386395 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-602315d6-c75d-48fb-9160-8265a8f1b281 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:57.396077 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-602315d6-c75d-48fb-9160-8265a8f1b281 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.175890 Jun 16 18:57:57.406147 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 110/236] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:57 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:58.275071 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-34999ed0-c228-4fcc-9bb2-8c69672c769a tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:58.276356 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-34999ed0-c228-4fcc-9bb2-8c69672c769a tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:58.305316 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-34999ed0-c228-4fcc-9bb2-8c69672c769a tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:58.306150 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-34999ed0-c228-4fcc-9bb2-8c69672c769a tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:58.308610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-34999ed0-c228-4fcc-9bb2-8c69672c769a tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:58.310301 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-34999ed0-c228-4fcc-9bb2-8c69672c769a tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:58.413823 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5ee8c0cf-823a-4982-bec7-6d3662859665 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:58.414444 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5ee8c0cf-823a-4982-bec7-6d3662859665 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:58.428353 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-34999ed0-c228-4fcc-9bb2-8c69672c769a tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:58.435143 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5ee8c0cf-823a-4982-bec7-6d3662859665 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:58.435598 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5ee8c0cf-823a-4982-bec7-6d3662859665 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:58.436114 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-34999ed0-c228-4fcc-9bb2-8c69672c769a tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1222 microversion: 2.1 time: 0.164971 Jun 16 18:57:58.436392 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5ee8c0cf-823a-4982-bec7-6d3662859665 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:58.436836 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5ee8c0cf-823a-4982-bec7-6d3662859665 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:58.436994 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 127/237] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:58 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1222 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:58.627781 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5ee8c0cf-823a-4982-bec7-6d3662859665 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:58.641751 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5ee8c0cf-823a-4982-bec7-6d3662859665 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.228308 Jun 16 18:57:58.642494 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 111/238] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:58 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:57:59.455122 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7c851584-e1a5-4d69-90ca-b268b0143968 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:59.456273 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7c851584-e1a5-4d69-90ca-b268b0143968 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:59.471109 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f39ebee9-0200-405a-99dd-e7efb4eb302a tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] Calling method '.version_select at 0x7f20141895e0>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:59.479799 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c851584-e1a5-4d69-90ca-b268b0143968 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:59.483036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c851584-e1a5-4d69-90ca-b268b0143968 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:59.483036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c851584-e1a5-4d69-90ca-b268b0143968 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:59.483036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c851584-e1a5-4d69-90ca-b268b0143968 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:59.490589 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=91 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:59.560573 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f39ebee9-0200-405a-99dd-e7efb4eb302a tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/34086f84-2a03-4ab7-92fd-efdc62a84457" status: 200 len: 351 microversion: 2.1 time: 0.093523 Jun 16 18:57:59.561461 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 112/239] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 18:57:59 2022] GET /compute/v2.1/os-volumes/34086f84-2a03-4ab7-92fd-efdc62a84457 => generated 351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:59.573231 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5b8a5779-f681-48c5-a828-fff86842a25a tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] Calling method '.version_select at 0x7f2014171550>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:59.602553 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7c851584-e1a5-4d69-90ca-b268b0143968 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:57:59.610941 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7c851584-e1a5-4d69-90ca-b268b0143968 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1270 microversion: 2.1 time: 0.159263 Jun 16 18:57:59.611302 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 128/240] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:59 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:59.660838 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-10bb7add-fd7c-4839-8a11-a8991ffaf2d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:59.661622 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-10bb7add-fd7c-4839-8a11-a8991ffaf2d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:57:59.676087 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10bb7add-fd7c-4839-8a11-a8991ffaf2d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:59.678438 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10bb7add-fd7c-4839-8a11-a8991ffaf2d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:59.680288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10bb7add-fd7c-4839-8a11-a8991ffaf2d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:59.681040 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10bb7add-fd7c-4839-8a11-a8991ffaf2d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:59.775314 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5b8a5779-f681-48c5-a828-fff86842a25a tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.205833 Jun 16 18:57:59.784772 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 113/241] 10.222.0.81 () {58 vars in 1133 bytes} [Thu Jun 16 18:57:59 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:59.800309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4fb798c1-5279-4bb2-a268-c20f71e716ec tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] Calling method '.version_select at 0x7f2014470f70>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:59.943194 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4fb798c1-5279-4bb2-a268-c20f71e716ec tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.151274 Jun 16 18:57:59.943897 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 114/242] 10.222.0.81 () {58 vars in 1148 bytes} [Thu Jun 16 18:57:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:59.971822 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ee4f1716-7dce-4067-8c4b-9a50185d7fe0 tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] Calling method '.version_select at 0x7f2014311d30>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:00.044730 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-10bb7add-fd7c-4839-8a11-a8991ffaf2d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:00.066969 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-10bb7add-fd7c-4839-8a11-a8991ffaf2d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.400414 Jun 16 18:58:00.071464 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 129/243] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:57:59 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:00.125649 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ee4f1716-7dce-4067-8c4b-9a50185d7fe0 tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.173878 Jun 16 18:58:00.126672 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 115/244] 10.222.0.81 () {58 vars in 1133 bytes} [Thu Jun 16 18:57:59 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:00.143552 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-082202bc-5a41-4557-9432-dd0584462861 tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] Calling method '.version_select at 0x7f201420dc10>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:00.239045 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-082202bc-5a41-4557-9432-dd0584462861 tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.104786 Jun 16 18:58:00.239624 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 130/245] 10.222.0.81 () {58 vars in 1166 bytes} [Thu Jun 16 18:58:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:00.251816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-dc63aa3a-118c-44e1-9853-be69407ea91b tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] Calling method '.version_select at 0x7f20141894c0>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:00.339824 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-dc63aa3a-118c-44e1-9853-be69407ea91b tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.091316 Jun 16 18:58:00.340408 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 116/246] 10.222.0.81 () {58 vars in 1169 bytes} [Thu Jun 16 18:58:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:00.352342 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-07a04154-2f76-4c1a-9548-7217cc94e9f0 tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] Calling method '.version_select at 0x7f20141a19d0>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:00.391748 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d08b6261-a23a-4151-b9c1-b5e0a3f80d9c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:00.392324 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d08b6261-a23a-4151-b9c1-b5e0a3f80d9c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:00.399212 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d08b6261-a23a-4151-b9c1-b5e0a3f80d9c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:00.401405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d08b6261-a23a-4151-b9c1-b5e0a3f80d9c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:00.402450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d08b6261-a23a-4151-b9c1-b5e0a3f80d9c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:00.402915 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d08b6261-a23a-4151-b9c1-b5e0a3f80d9c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:00.430723 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d08b6261-a23a-4151-b9c1-b5e0a3f80d9c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/ips" status: 200 len: 151 microversion: 2.20 time: 0.042817 Jun 16 18:58:00.437275 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 117/247] 10.222.0.81 () {60 vars in 1288 bytes} [Thu Jun 16 18:58:00 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:58:00.437419 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-07a04154-2f76-4c1a-9548-7217cc94e9f0 tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.085989 Jun 16 18:58:00.437419 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 131/248] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jun 16 18:58:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:00.451521 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-87646f25-440b-46cb-b23d-c99f0dc30030 tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] Calling method '.version_select at 0x7f2014321670>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:00.533763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-87646f25-440b-46cb-b23d-c99f0dc30030 tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085970 Jun 16 18:58:00.539625 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 118/249] 10.222.0.81 () {58 vars in 1187 bytes} [Thu Jun 16 18:58:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:00.548282 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4762c287-3eb6-4122-a267-f02eb865b98c tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] Calling method '.version_select at 0x7f2014214ee0>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:00.628100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-09caec4a-cee7-4322-8074-869c342beddd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:00.628716 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-09caec4a-cee7-4322-8074-869c342beddd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:00.635938 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-09caec4a-cee7-4322-8074-869c342beddd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:00.636386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-09caec4a-cee7-4322-8074-869c342beddd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:00.643165 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-09caec4a-cee7-4322-8074-869c342beddd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:00.643165 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-09caec4a-cee7-4322-8074-869c342beddd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:00.645227 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4762c287-3eb6-4122-a267-f02eb865b98c tempest-VolumesTestJSON-139948393 tempest-VolumesTestJSON-139948393-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.101700 Jun 16 18:58:00.645885 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 132/250] 10.222.0.81 () {58 vars in 1154 bytes} [Thu Jun 16 18:58:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:00.738543 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-09caec4a-cee7-4322-8074-869c342beddd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:00.746879 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-09caec4a-cee7-4322-8074-869c342beddd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1278 microversion: 2.1 time: 0.122685 Jun 16 18:58:00.747460 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 119/251] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:00 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:01.087545 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e1716cf5-1c2c-4ff3-b3f5-4986271cacb5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:01.088151 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e1716cf5-1c2c-4ff3-b3f5-4986271cacb5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:01.094776 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e1716cf5-1c2c-4ff3-b3f5-4986271cacb5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:01.095422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e1716cf5-1c2c-4ff3-b3f5-4986271cacb5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:01.096192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e1716cf5-1c2c-4ff3-b3f5-4986271cacb5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:01.096626 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e1716cf5-1c2c-4ff3-b3f5-4986271cacb5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:01.230627 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e1716cf5-1c2c-4ff3-b3f5-4986271cacb5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:01.239413 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e1716cf5-1c2c-4ff3-b3f5-4986271cacb5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.155853 Jun 16 18:58:01.250217 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 133/252] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:01 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:01.647570 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ebbd2d01-93c2-44bd-b718-2108f93f7010 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:01.648123 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ebbd2d01-93c2-44bd-b718-2108f93f7010 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:01.655135 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ebbd2d01-93c2-44bd-b718-2108f93f7010 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:01.655594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ebbd2d01-93c2-44bd-b718-2108f93f7010 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:01.656391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ebbd2d01-93c2-44bd-b718-2108f93f7010 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:01.656829 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ebbd2d01-93c2-44bd-b718-2108f93f7010 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:01.684913 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ebbd2d01-93c2-44bd-b718-2108f93f7010 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/ips" status: 200 len: 145 microversion: 2.1 time: 0.041810 Jun 16 18:58:01.685843 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 120/253] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jun 16 18:58:01 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:01.764430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c1f7104b-fd51-419e-8ec1-4dd2b8f85ebf tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:01.765044 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c1f7104b-fd51-419e-8ec1-4dd2b8f85ebf tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:01.771592 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c1f7104b-fd51-419e-8ec1-4dd2b8f85ebf tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:01.772044 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c1f7104b-fd51-419e-8ec1-4dd2b8f85ebf tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:01.772879 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c1f7104b-fd51-419e-8ec1-4dd2b8f85ebf tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:01.773349 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c1f7104b-fd51-419e-8ec1-4dd2b8f85ebf tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:01.867750 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c1f7104b-fd51-419e-8ec1-4dd2b8f85ebf tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:01.876840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c1f7104b-fd51-419e-8ec1-4dd2b8f85ebf tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1278 microversion: 2.1 time: 0.116811 Jun 16 18:58:01.879835 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 134/254] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:01 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1278 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:02.259378 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-614e7d69-cf65-4430-9b89-1e51211b704a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:02.259378 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-614e7d69-cf65-4430-9b89-1e51211b704a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:02.270054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-614e7d69-cf65-4430-9b89-1e51211b704a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:02.274182 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-614e7d69-cf65-4430-9b89-1e51211b704a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:02.277373 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-614e7d69-cf65-4430-9b89-1e51211b704a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:02.281601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-614e7d69-cf65-4430-9b89-1e51211b704a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:02.541465 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-614e7d69-cf65-4430-9b89-1e51211b704a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:02.551718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-614e7d69-cf65-4430-9b89-1e51211b704a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.297315 Jun 16 18:58:02.552954 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 121/255] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:02 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:02.893878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-de21a19d-2b87-4ab8-9956-9e4d3980d4db tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:02.895084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-de21a19d-2b87-4ab8-9956-9e4d3980d4db tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:02.901568 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-de21a19d-2b87-4ab8-9956-9e4d3980d4db tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:02.902400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-de21a19d-2b87-4ab8-9956-9e4d3980d4db tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:02.903353 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-de21a19d-2b87-4ab8-9956-9e4d3980d4db tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:02.904082 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-de21a19d-2b87-4ab8-9956-9e4d3980d4db tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:02.986528 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-de21a19d-2b87-4ab8-9956-9e4d3980d4db tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:02.995221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-de21a19d-2b87-4ab8-9956-9e4d3980d4db tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1278 microversion: 2.1 time: 0.105301 Jun 16 18:58:02.996190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 135/256] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:02 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1278 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:03.570912 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ee95287b-3bd9-44cf-be82-c2e8df46ed3d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:03.574126 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ee95287b-3bd9-44cf-be82-c2e8df46ed3d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:03.579278 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:03.584755 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ee95287b-3bd9-44cf-be82-c2e8df46ed3d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:03.585211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ee95287b-3bd9-44cf-be82-c2e8df46ed3d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:03.593660 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ee95287b-3bd9-44cf-be82-c2e8df46ed3d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:03.594167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ee95287b-3bd9-44cf-be82-c2e8df46ed3d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:04.029523 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-065f8896-7700-4430-8ca3-568a742eb1c4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:04.030826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-065f8896-7700-4430-8ca3-568a742eb1c4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:04.040864 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:04.042018 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=6 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:04.044855 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-065f8896-7700-4430-8ca3-568a742eb1c4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:04.045697 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-065f8896-7700-4430-8ca3-568a742eb1c4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:04.047130 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-065f8896-7700-4430-8ca3-568a742eb1c4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:04.048584 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-065f8896-7700-4430-8ca3-568a742eb1c4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:04.183800 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ee95287b-3bd9-44cf-be82-c2e8df46ed3d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:04.185165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-065f8896-7700-4430-8ca3-568a742eb1c4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:04.191920 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ee95287b-3bd9-44cf-be82-c2e8df46ed3d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.624964 Jun 16 18:58:04.203495 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 122/257] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:03 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:04.203961 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-065f8896-7700-4430-8ca3-568a742eb1c4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1288 microversion: 2.1 time: 0.190513 Jun 16 18:58:04.206153 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 136/258] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:04 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1288 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:04.422421 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-20538058-4f28-4bc5-a10f-d276f145bcd9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d86e8470-a372-4cd5-9c92-a72e4cc17540"}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:04.424924 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-20538058-4f28-4bc5-a10f-d276f145bcd9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:04.434171 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-20538058-4f28-4bc5-a10f-d276f145bcd9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:04.435266 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-20538058-4f28-4bc5-a10f-d276f145bcd9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:04.436782 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-20538058-4f28-4bc5-a10f-d276f145bcd9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:04.437911 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-20538058-4f28-4bc5-a10f-d276f145bcd9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:04.961251 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=4 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:05.211161 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e510a7be-edc6-4bd6-ad38-89c03c9ff58f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:05.211781 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e510a7be-edc6-4bd6-ad38-89c03c9ff58f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:05.227879 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e510a7be-edc6-4bd6-ad38-89c03c9ff58f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:05.235092 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e510a7be-edc6-4bd6-ad38-89c03c9ff58f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:05.235092 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e510a7be-edc6-4bd6-ad38-89c03c9ff58f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:05.235785 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e510a7be-edc6-4bd6-ad38-89c03c9ff58f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:05.430361 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e510a7be-edc6-4bd6-ad38-89c03c9ff58f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:05.440838 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e510a7be-edc6-4bd6-ad38-89c03c9ff58f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1500 microversion: 2.1 time: 0.233529 Jun 16 18:58:05.452452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 137/259] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:05 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1500 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:05.452452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d7e2a3af-940c-4226-b4f3-16e7f6d863e1 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:05.452452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d7e2a3af-940c-4226-b4f3-16e7f6d863e1 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:05.455860 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d7e2a3af-940c-4226-b4f3-16e7f6d863e1 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:05.456313 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d7e2a3af-940c-4226-b4f3-16e7f6d863e1 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:05.457290 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d7e2a3af-940c-4226-b4f3-16e7f6d863e1 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:05.457735 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d7e2a3af-940c-4226-b4f3-16e7f6d863e1 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:05.557070 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-20538058-4f28-4bc5-a10f-d276f145bcd9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "POST /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.139597 Jun 16 18:58:05.563498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 123/260] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jun 16 18:58:04 2022] POST /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/os-volume_attachments => generated 194 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:05.601352 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2afb2d3e-63f3-4fac-acc4-a135b25614a3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:05.602287 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2afb2d3e-63f3-4fac-acc4-a135b25614a3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:05.621958 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2afb2d3e-63f3-4fac-acc4-a135b25614a3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:05.625053 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2afb2d3e-63f3-4fac-acc4-a135b25614a3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:05.629527 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2afb2d3e-63f3-4fac-acc4-a135b25614a3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:05.630373 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2afb2d3e-63f3-4fac-acc4-a135b25614a3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:05.670869 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d7e2a3af-940c-4226-b4f3-16e7f6d863e1 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:05.692796 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d7e2a3af-940c-4226-b4f3-16e7f6d863e1 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1318 microversion: 2.1 time: 0.250256 Jun 16 18:58:05.694003 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 138/261] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:05 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:05.701123 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f6c88f5e-79fd-4c31-ba23-678e78cbc8d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3481ed6-3bad-48c0-8fde-c35d03038c71"}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:05.702876 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f6c88f5e-79fd-4c31-ba23-678e78cbc8d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:05.711601 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f6c88f5e-79fd-4c31-ba23-678e78cbc8d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:05.712699 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f6c88f5e-79fd-4c31-ba23-678e78cbc8d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:05.714188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f6c88f5e-79fd-4c31-ba23-678e78cbc8d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:05.715000 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f6c88f5e-79fd-4c31-ba23-678e78cbc8d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:05.757821 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.objects.instance [None req-2afb2d3e-63f3-4fac-acc4-a135b25614a3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lazy-loading 'flavor' on Instance uuid d6c04798-b061-421b-9b61-db9cce7dace4 {{(pid=130230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:58:05.771271 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-f6c88f5e-79fd-4c31-ba23-678e78cbc8d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] HTTP exception thrown: Cannot 'attach_volume' instance 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b while it is in vm_state rescued Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f6c88f5e-79fd-4c31-ba23-678e78cbc8d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Request method failure captured: Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: POST /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b/os-volume_attachments HTTP/1.1 Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 74 Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq3zGXPpz6QpTlYMAzUwZA2FxpZlcsMj2PZk5Me98X004ESO6iHhtyZi01S2HrA7QRavaFYn_gvj72vUb3j1o8y1FEQDlH2mCzxj0otKQa2G_t9ABiX9PFlgtXlKad4vu-Z7kFV6K2VyP4Foc5kZ5IbGmbuR92aI1zzs_J7gOZWCDPP0 Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: ed8501d1ff734054ba0a6ef4c398d051 Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1664066176 Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 18:58:05.774741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 18:58:05.776385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ed8501d1ff734054ba0a6ef4c398d051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ed8501d1ff734054ba0a6ef4c398d051", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ed8501d1ff734054ba0a6ef4c398d051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ed8501d1ff734054ba0a6ef4c398d051"}]}] Jun 16 18:58:05.776385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1664066176 Jun 16 18:58:05.776385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: ed8501d1ff734054ba0a6ef4c398d051 Jun 16 18:58:05.776385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1664066176 Jun 16 18:58:05.776385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-ServerRescueNegativeTestJSON-1664066176-project Jun 16 18:58:05.776385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 18:58:05.776385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 18:58:05.776385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 7310c631282c495a83e17dbdbc6d2ba0 Jun 16 18:58:05.776385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1664066176-project Jun 16 18:58:05.776385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Jun 16 18:58:05.776385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {"volumeAttachment": {"volumeId": "f3481ed6-3bad-48c0-8fde-c35d03038c71"}} Jun 16 18:58:05.776385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Cannot 'attach_volume' instance 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b while it is in vm_state rescued Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'server_id': '25fe61a4-e1c1-4098-91db-fbb42c8b1d7b', 'body': {'volumeAttachment': {'volumeId': 'f3481ed6-3bad-48c0-8fde-c35d03038c71'}}} Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:58:05.777365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b while it is in vm_state rescued Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:58:05.778618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:58:05.779892 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:58:05.779892 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:58:05.779892 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b while it is in vm_state rescued Jun 16 18:58:05.779892 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:58:05.779892 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f6c88f5e-79fd-4c31-ba23-678e78cbc8d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Returning 409 to user: Cannot 'attach_volume' instance 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b while it is in vm_state rescued {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:58:05.779892 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f6c88f5e-79fd-4c31-ba23-678e78cbc8d9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "POST /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.083597 Jun 16 18:58:05.785074 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 139/262] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jun 16 18:58:05 2022] POST /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b/os-volume_attachments => generated 152 bytes in 90 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 18:58:05.793873 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b5cb06e1-5209-403c-894a-a6839a116c2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:05.794742 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b5cb06e1-5209-403c-894a-a6839a116c2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:05.801439 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5cb06e1-5209-403c-894a-a6839a116c2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:05.801931 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5cb06e1-5209-403c-894a-a6839a116c2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:05.802869 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5cb06e1-5209-403c-894a-a6839a116c2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:05.803309 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5cb06e1-5209-403c-894a-a6839a116c2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:06.161676 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b5cb06e1-5209-403c-894a-a6839a116c2e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "POST /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b/action" status: 202 len: 0 microversion: 2.1 time: 0.374699 Jun 16 18:58:06.163101 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 140/263] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jun 16 18:58:05 2022] POST /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:58:06.191682 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5cf24ad7-12f9-45b9-b26c-4dc72d72cf8f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:06.192663 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5cf24ad7-12f9-45b9-b26c-4dc72d72cf8f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:06.203384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5cf24ad7-12f9-45b9-b26c-4dc72d72cf8f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:06.204099 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5cf24ad7-12f9-45b9-b26c-4dc72d72cf8f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:06.205227 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5cf24ad7-12f9-45b9-b26c-4dc72d72cf8f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:06.205901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5cf24ad7-12f9-45b9-b26c-4dc72d72cf8f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:06.470414 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5cf24ad7-12f9-45b9-b26c-4dc72d72cf8f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:06.479104 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5cf24ad7-12f9-45b9-b26c-4dc72d72cf8f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1508 microversion: 2.1 time: 0.311417 Jun 16 18:58:06.480446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 141/264] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:06 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1508 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:06.536477 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2afb2d3e-63f3-4fac-acc4-a135b25614a3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "POST /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/action" status: 202 len: 0 microversion: 2.20 time: 0.970771 Jun 16 18:58:06.537903 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 124/265] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jun 16 18:58:05 2022] POST /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/action => generated 0 bytes in 973 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:58:06.547805 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4b94c9d4-cbc4-42bf-b936-95ad5e9ddaf2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:06.548967 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4b94c9d4-cbc4-42bf-b936-95ad5e9ddaf2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:06.557103 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4b94c9d4-cbc4-42bf-b936-95ad5e9ddaf2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:06.557677 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4b94c9d4-cbc4-42bf-b936-95ad5e9ddaf2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:06.558698 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4b94c9d4-cbc4-42bf-b936-95ad5e9ddaf2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:06.559330 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4b94c9d4-cbc4-42bf-b936-95ad5e9ddaf2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:06.713003 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-29ac441b-d891-4e2b-82f9-3fb43657c3c3 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:06.717750 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-29ac441b-d891-4e2b-82f9-3fb43657c3c3 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:06.739227 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29ac441b-d891-4e2b-82f9-3fb43657c3c3 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:06.740294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29ac441b-d891-4e2b-82f9-3fb43657c3c3 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:06.741215 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29ac441b-d891-4e2b-82f9-3fb43657c3c3 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:06.744105 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29ac441b-d891-4e2b-82f9-3fb43657c3c3 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:06.744827 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4b94c9d4-cbc4-42bf-b936-95ad5e9ddaf2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:06.755002 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4b94c9d4-cbc4-42bf-b936-95ad5e9ddaf2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:06.757069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4b94c9d4-cbc4-42bf-b936-95ad5e9ddaf2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:06.758618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4b94c9d4-cbc4-42bf-b936-95ad5e9ddaf2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.215653 Jun 16 18:58:06.759446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 142/266] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:06 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:07.028137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-29ac441b-d891-4e2b-82f9-3fb43657c3c3 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:07.036796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-29ac441b-d891-4e2b-82f9-3fb43657c3c3 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1318 microversion: 2.1 time: 0.329341 Jun 16 18:58:07.046947 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 125/267] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:06 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:07.416954 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-1a8bb334-3175-4ee0-810b-2df4fd0a9ef8 req-da087fa6-5533-4388-9835-c63b919cb8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5fb9a14-5c4d-4dcd-9728-85313113a15e", "tag": "80388b4f-0d36-43aa-8acd-308c5eefc7ba"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:07.428865 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-1a8bb334-3175-4ee0-810b-2df4fd0a9ef8 req-da087fa6-5533-4388-9835-c63b919cb8a6 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:07.429360 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-1a8bb334-3175-4ee0-810b-2df4fd0a9ef8 req-da087fa6-5533-4388-9835-c63b919cb8a6 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:07.441695 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-1a8bb334-3175-4ee0-810b-2df4fd0a9ef8 req-da087fa6-5533-4388-9835-c63b919cb8a6 service nova] Creating event network-changed:80388b4f-0d36-43aa-8acd-308c5eefc7ba for instance c5fb9a14-5c4d-4dcd-9728-85313113a15e on hv-cinder-84617 Jun 16 18:58:07.447123 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-1a8bb334-3175-4ee0-810b-2df4fd0a9ef8 req-da087fa6-5533-4388-9835-c63b919cb8a6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034973 Jun 16 18:58:07.448957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 143/268] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:07.497929 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d3440c36-360c-47f5-9e95-97fccdd707d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:07.506686 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d3440c36-360c-47f5-9e95-97fccdd707d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:07.506686 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d3440c36-360c-47f5-9e95-97fccdd707d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:07.506686 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d3440c36-360c-47f5-9e95-97fccdd707d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:07.508047 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d3440c36-360c-47f5-9e95-97fccdd707d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:07.508576 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d3440c36-360c-47f5-9e95-97fccdd707d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:07.514160 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:07.688284 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d3440c36-360c-47f5-9e95-97fccdd707d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:07.696627 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d3440c36-360c-47f5-9e95-97fccdd707d2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1508 microversion: 2.1 time: 0.203714 Jun 16 18:58:07.697906 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 126/269] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:07 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:07.788877 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0454595e-eda4-4298-8f1e-98126d0d4e0d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:07.793842 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0454595e-eda4-4298-8f1e-98126d0d4e0d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:07.811333 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0454595e-eda4-4298-8f1e-98126d0d4e0d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:07.812062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0454595e-eda4-4298-8f1e-98126d0d4e0d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:07.813232 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0454595e-eda4-4298-8f1e-98126d0d4e0d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:07.813882 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0454595e-eda4-4298-8f1e-98126d0d4e0d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:08.037928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0454595e-eda4-4298-8f1e-98126d0d4e0d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:08.049433 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0454595e-eda4-4298-8f1e-98126d0d4e0d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:08.051414 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0454595e-eda4-4298-8f1e-98126d0d4e0d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:08.052694 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0454595e-eda4-4298-8f1e-98126d0d4e0d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.278042 Jun 16 18:58:08.053412 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 144/270] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:07 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:58:08.060479 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6e87b553-23d9-4a39-81a2-3a3ac2bad3cc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:08.061489 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6e87b553-23d9-4a39-81a2-3a3ac2bad3cc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:08.069300 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6e87b553-23d9-4a39-81a2-3a3ac2bad3cc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:08.070020 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6e87b553-23d9-4a39-81a2-3a3ac2bad3cc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:08.070983 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6e87b553-23d9-4a39-81a2-3a3ac2bad3cc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:08.071605 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6e87b553-23d9-4a39-81a2-3a3ac2bad3cc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:08.332154 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6e87b553-23d9-4a39-81a2-3a3ac2bad3cc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:08.340441 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6e87b553-23d9-4a39-81a2-3a3ac2bad3cc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1318 microversion: 2.1 time: 0.284794 Jun 16 18:58:08.341517 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 127/271] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:08 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:08.715126 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ca1304bb-dc80-4c56-86ec-96575b116572 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:08.716444 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ca1304bb-dc80-4c56-86ec-96575b116572 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:08.723627 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ca1304bb-dc80-4c56-86ec-96575b116572 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:08.724304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ca1304bb-dc80-4c56-86ec-96575b116572 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:08.725574 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ca1304bb-dc80-4c56-86ec-96575b116572 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:08.726166 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ca1304bb-dc80-4c56-86ec-96575b116572 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:08.883855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ca1304bb-dc80-4c56-86ec-96575b116572 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:08.891601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ca1304bb-dc80-4c56-86ec-96575b116572 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1508 microversion: 2.1 time: 0.180986 Jun 16 18:58:08.892632 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 128/272] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:08 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:08.966897 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d00e7eb6-4902-48cc-8e61-483ab8c9f0f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Action: 'create', calling method: .version_select at 0x7f20141a1550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1310473773", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDLiFoQSIyso4KL0vidfyGVAqA7ap/Qa2Yvn9K+pYE2PKu+alQRn2P3A7+zFdQOa2l7MKOZRGkaMWfTUyC9MlhKeQ9zenj9F2QvCthGq38ZzLWpoV2pCuRPq3WFX5G1cQ=="}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:08.981592 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-d00e7eb6-4902-48cc-8e61-483ab8c9f0f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Getting quotas for project fc32e3179c534d83b3d4108a38fb9d19. Resources: {'key_pairs'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:58:08.985496 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-d00e7eb6-4902-48cc-8e61-483ab8c9f0f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Getting quotas for user 1c0e7e9f9d0f409a8820d8bd8dd239cf and project fc32e3179c534d83b3d4108a38fb9d19. Resources: {'key_pairs'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:58:09.072613 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5fe36fa7-6b71-4b34-8a33-324b214bb742 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:09.073333 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5fe36fa7-6b71-4b34-8a33-324b214bb742 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:09.080639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5fe36fa7-6b71-4b34-8a33-324b214bb742 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:09.081146 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5fe36fa7-6b71-4b34-8a33-324b214bb742 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:09.081971 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5fe36fa7-6b71-4b34-8a33-324b214bb742 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:09.082426 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5fe36fa7-6b71-4b34-8a33-324b214bb742 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:09.097753 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d00e7eb6-4902-48cc-8e61-483ab8c9f0f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.401418 Jun 16 18:58:09.098567 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 145/273] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jun 16 18:58:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:09.319157 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5fe36fa7-6b71-4b34-8a33-324b214bb742 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:09.329422 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5fe36fa7-6b71-4b34-8a33-324b214bb742 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:09.334036 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5fe36fa7-6b71-4b34-8a33-324b214bb742 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:09.336763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5fe36fa7-6b71-4b34-8a33-324b214bb742 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.268571 Jun 16 18:58:09.340412 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 129/274] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:09 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:58:09.365383 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-08f2c8a9-ed86-4c77-a7a8-5ad0220ac27c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:09.365383 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-08f2c8a9-ed86-4c77-a7a8-5ad0220ac27c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:09.373388 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1034073701", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-653739164", "security_groups": [{"name": "tempest-secgroup-smoke-416391496"}], "networks": [{"uuid": "0dec2021-b64c-4fc7-9ff0-960200894783"}], "block_device_mapping_v2": [{"uuid": "7c810bc2-4dfb-444e-a6bc-fc1721c81772", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:09.383718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:09.388812 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08f2c8a9-ed86-4c77-a7a8-5ad0220ac27c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:09.390922 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08f2c8a9-ed86-4c77-a7a8-5ad0220ac27c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:09.393585 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08f2c8a9-ed86-4c77-a7a8-5ad0220ac27c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:09.394116 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08f2c8a9-ed86-4c77-a7a8-5ad0220ac27c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:09.603994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.network.neutron [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] validate_networks() for [('0dec2021-b64c-4fc7-9ff0-960200894783', None, None, None, None, None)] {{(pid=130230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:58:09.775290 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-08f2c8a9-ed86-4c77-a7a8-5ad0220ac27c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:09.800535 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-08f2c8a9-ed86-4c77-a7a8-5ad0220ac27c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1318 microversion: 2.1 time: 0.447006 Jun 16 18:58:09.801773 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 146/275] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:09 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1318 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:09.910014 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-72c8aa40-6fdc-4565-b66e-5df5a9017df0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:09.910845 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-72c8aa40-6fdc-4565-b66e-5df5a9017df0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:09.919948 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-72c8aa40-6fdc-4565-b66e-5df5a9017df0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:09.920402 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-72c8aa40-6fdc-4565-b66e-5df5a9017df0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:09.923769 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-72c8aa40-6fdc-4565-b66e-5df5a9017df0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:09.925890 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-72c8aa40-6fdc-4565-b66e-5df5a9017df0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:10.220182 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-72c8aa40-6fdc-4565-b66e-5df5a9017df0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:10.228383 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-72c8aa40-6fdc-4565-b66e-5df5a9017df0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1514 microversion: 2.1 time: 0.324006 Jun 16 18:58:10.229796 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 147/276] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:09 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1514 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:10.357968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4a8da7ef-8559-4f4c-bcd0-70bb15e9a386 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:10.358572 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4a8da7ef-8559-4f4c-bcd0-70bb15e9a386 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:10.373557 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4a8da7ef-8559-4f4c-bcd0-70bb15e9a386 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:10.374046 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4a8da7ef-8559-4f4c-bcd0-70bb15e9a386 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:10.374990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4a8da7ef-8559-4f4c-bcd0-70bb15e9a386 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:10.375432 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4a8da7ef-8559-4f4c-bcd0-70bb15e9a386 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:10.467415 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Flavor limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:58:10.469232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Image limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:58:10.470192 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Flavor pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:58:10.471394 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Image pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:58:10.471973 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:58:10.485870 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:10.486540 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:10.487929 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:10.488527 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:10.509103 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Getting quotas for project 5db8d64fab0e45ffbba87b1ae3b48703. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:58:10.515527 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Getting quotas for user 0569765b6f07473fa07a5376b3677da8 and project 5db8d64fab0e45ffbba87b1ae3b48703. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:58:10.566313 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4a8da7ef-8559-4f4c-bcd0-70bb15e9a386 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:10.577780 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:10.596850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4a8da7ef-8559-4f4c-bcd0-70bb15e9a386 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:10.605331 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4a8da7ef-8559-4f4c-bcd0-70bb15e9a386 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:10.606860 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4a8da7ef-8559-4f4c-bcd0-70bb15e9a386 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.254782 Jun 16 18:58:10.607437 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 148/277] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:10 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:58:10.619011 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Going to run 1 instances... {{(pid=130230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:58:10.625823 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7c810bc2-4dfb-444e-a6bc-fc1721c81772',volume_size=None,volume_type=None)] {{(pid=130230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:58:10.825297 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-cadadc31-7258-4521-8aa8-59f58517e9df tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:10.826373 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-cadadc31-7258-4521-8aa8-59f58517e9df tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:10.865958 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cadadc31-7258-4521-8aa8-59f58517e9df tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:10.865958 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cadadc31-7258-4521-8aa8-59f58517e9df tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:10.865958 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cadadc31-7258-4521-8aa8-59f58517e9df tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:10.865958 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cadadc31-7258-4521-8aa8-59f58517e9df tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:11.054775 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cadadc31-7258-4521-8aa8-59f58517e9df tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:11.063090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-cadadc31-7258-4521-8aa8-59f58517e9df tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1318 microversion: 2.1 time: 0.249104 Jun 16 18:58:11.072270 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 149/278] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:10 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:11.256767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-83ed5361-16af-4585-b76d-c50e7f4c2146 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.889710 Jun 16 18:58:11.258075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 130/279] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 18:58:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:58:11.273454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-fbd487cf-2f2a-42e7-b52f-bbb34bb44527 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:11.273454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-fbd487cf-2f2a-42e7-b52f-bbb34bb44527 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:11.370450 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-fbd487cf-2f2a-42e7-b52f-bbb34bb44527 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:11.379917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-fbd487cf-2f2a-42e7-b52f-bbb34bb44527 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1088 microversion: 2.1 time: 0.114722 Jun 16 18:58:11.380583 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 150/280] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:11 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1088 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:11.636611 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4896f37a-f98c-4e3b-b18d-b2f50d014674 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:11.639170 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4896f37a-f98c-4e3b-b18d-b2f50d014674 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:11.676621 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4896f37a-f98c-4e3b-b18d-b2f50d014674 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:11.678770 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4896f37a-f98c-4e3b-b18d-b2f50d014674 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:11.679743 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4896f37a-f98c-4e3b-b18d-b2f50d014674 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:11.680337 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4896f37a-f98c-4e3b-b18d-b2f50d014674 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:11.893781 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4896f37a-f98c-4e3b-b18d-b2f50d014674 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:11.902829 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4896f37a-f98c-4e3b-b18d-b2f50d014674 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:11.904366 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4896f37a-f98c-4e3b-b18d-b2f50d014674 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:11.905694 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4896f37a-f98c-4e3b-b18d-b2f50d014674 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.280331 Jun 16 18:58:11.906270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 131/281] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:11 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:12.080301 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-74a40638-6bf0-4650-b982-ea3c3a7b62af tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:12.081519 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-74a40638-6bf0-4650-b982-ea3c3a7b62af tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:12.094321 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-74a40638-6bf0-4650-b982-ea3c3a7b62af tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:12.094837 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-74a40638-6bf0-4650-b982-ea3c3a7b62af tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:12.098423 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-74a40638-6bf0-4650-b982-ea3c3a7b62af tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:12.098997 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-74a40638-6bf0-4650-b982-ea3c3a7b62af tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:12.369910 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-74a40638-6bf0-4650-b982-ea3c3a7b62af tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:12.388355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-74a40638-6bf0-4650-b982-ea3c3a7b62af tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1318 microversion: 2.1 time: 0.312051 Jun 16 18:58:12.395492 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 151/282] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:12 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:12.397353 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-7a5890c3-9d54-4b31-b6bb-2d6b53a96bd0 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:12.398054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-7a5890c3-9d54-4b31-b6bb-2d6b53a96bd0 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:12.481381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-7a5890c3-9d54-4b31-b6bb-2d6b53a96bd0 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:12.488805 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-7a5890c3-9d54-4b31-b6bb-2d6b53a96bd0 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1088 microversion: 2.1 time: 0.095905 Jun 16 18:58:12.489502 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 132/283] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:12 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1088 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:12.924017 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-468a9ade-e910-4900-be18-3bd695987512 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:12.924250 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-468a9ade-e910-4900-be18-3bd695987512 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:12.931307 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-468a9ade-e910-4900-be18-3bd695987512 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:12.932133 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-468a9ade-e910-4900-be18-3bd695987512 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:12.932935 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-468a9ade-e910-4900-be18-3bd695987512 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:12.933402 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-468a9ade-e910-4900-be18-3bd695987512 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:13.098318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-468a9ade-e910-4900-be18-3bd695987512 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:13.117298 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-468a9ade-e910-4900-be18-3bd695987512 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:13.118916 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-468a9ade-e910-4900-be18-3bd695987512 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:13.120210 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-468a9ade-e910-4900-be18-3bd695987512 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.200446 Jun 16 18:58:13.121181 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 152/284] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:12 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:13.176081 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-fd611464-c410-4eed-b6e3-02229fcd4859 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Action: 'create', calling method: .version_select at 0x7f20142abee0>, body: {"keypair": {"name": "tempest-keypair-281560677", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAW+Ep33hgfpkdAzh3YzTFGB/P0HV4JWBPRFFVdQRHthy1Ouc3/fAdFjA1NJPRu+fNul7wc3/p7rwSTM8xpNMID1e+EsB8iPY0YKYLXta0vJvoAtTiCnJBZ3ogJ0sTPg9g=="}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:13.193661 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-fd611464-c410-4eed-b6e3-02229fcd4859 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Getting quotas for project ed8501d1ff734054ba0a6ef4c398d051. Resources: {'key_pairs'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:58:13.198934 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-fd611464-c410-4eed-b6e3-02229fcd4859 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Getting quotas for user 7310c631282c495a83e17dbdbc6d2ba0 and project ed8501d1ff734054ba0a6ef4c398d051. Resources: {'key_pairs'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:58:13.285253 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-fd611464-c410-4eed-b6e3-02229fcd4859 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.113708 Jun 16 18:58:13.285884 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 133/285] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jun 16 18:58:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:13.415922 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6201b5ce-142d-4097-89e7-3f6756fde351 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:13.416551 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6201b5ce-142d-4097-89e7-3f6756fde351 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:13.428620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6201b5ce-142d-4097-89e7-3f6756fde351 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:13.429371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6201b5ce-142d-4097-89e7-3f6756fde351 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:13.430308 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6201b5ce-142d-4097-89e7-3f6756fde351 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:13.431031 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6201b5ce-142d-4097-89e7-3f6756fde351 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:13.509677 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4df8e141-b02e-469d-9253-43db51aca2a2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:13.511103 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4df8e141-b02e-469d-9253-43db51aca2a2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:13.518518 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4df8e141-b02e-469d-9253-43db51aca2a2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:13.520765 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4df8e141-b02e-469d-9253-43db51aca2a2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:13.521774 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4df8e141-b02e-469d-9253-43db51aca2a2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:13.522332 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4df8e141-b02e-469d-9253-43db51aca2a2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:13.613122 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4df8e141-b02e-469d-9253-43db51aca2a2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:13.622725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4df8e141-b02e-469d-9253-43db51aca2a2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1130 microversion: 2.1 time: 0.120168 Jun 16 18:58:13.623327 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 134/286] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:13 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1130 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:13.644910 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6201b5ce-142d-4097-89e7-3f6756fde351 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:13.653343 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6201b5ce-142d-4097-89e7-3f6756fde351 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1318 microversion: 2.1 time: 0.252154 Jun 16 18:58:13.654012 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 153/287] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:13 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:14.141922 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e2b84415-3d9e-4012-ba97-586b773c7b98 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:14.142535 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e2b84415-3d9e-4012-ba97-586b773c7b98 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:14.152573 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e2b84415-3d9e-4012-ba97-586b773c7b98 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:14.154194 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e2b84415-3d9e-4012-ba97-586b773c7b98 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:14.157855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e2b84415-3d9e-4012-ba97-586b773c7b98 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:14.158504 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e2b84415-3d9e-4012-ba97-586b773c7b98 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:14.313998 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e2b84415-3d9e-4012-ba97-586b773c7b98 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:14.325060 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e2b84415-3d9e-4012-ba97-586b773c7b98 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:14.326430 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e2b84415-3d9e-4012-ba97-586b773c7b98 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:14.327657 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e2b84415-3d9e-4012-ba97-586b773c7b98 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.189965 Jun 16 18:58:14.328619 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 135/288] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:14 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:14.640780 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d01be597-59a1-4a1d-96ef-0546c6006522 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:14.641608 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d01be597-59a1-4a1d-96ef-0546c6006522 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:14.659407 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d01be597-59a1-4a1d-96ef-0546c6006522 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:14.664106 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d01be597-59a1-4a1d-96ef-0546c6006522 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:14.666099 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d01be597-59a1-4a1d-96ef-0546c6006522 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:14.667422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d01be597-59a1-4a1d-96ef-0546c6006522 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:14.671390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9a10974b-1411-4fc3-9fef-f9f879d9b999 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:14.672801 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9a10974b-1411-4fc3-9fef-f9f879d9b999 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:14.684804 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9a10974b-1411-4fc3-9fef-f9f879d9b999 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:14.685650 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9a10974b-1411-4fc3-9fef-f9f879d9b999 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:14.686645 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9a10974b-1411-4fc3-9fef-f9f879d9b999 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:14.687240 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9a10974b-1411-4fc3-9fef-f9f879d9b999 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:14.766606 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d01be597-59a1-4a1d-96ef-0546c6006522 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:14.775444 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d01be597-59a1-4a1d-96ef-0546c6006522 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1130 microversion: 2.1 time: 0.139777 Jun 16 18:58:14.778179 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 154/289] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:14 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1130 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:14.908505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9a10974b-1411-4fc3-9fef-f9f879d9b999 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:14.916855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9a10974b-1411-4fc3-9fef-f9f879d9b999 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1318 microversion: 2.1 time: 0.250268 Jun 16 18:58:14.917536 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 136/290] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:14 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:15.346474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6c002994-e6ce-48f4-bbf9-54ccadddc765 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:15.347109 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6c002994-e6ce-48f4-bbf9-54ccadddc765 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:15.354560 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c002994-e6ce-48f4-bbf9-54ccadddc765 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:15.359764 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c002994-e6ce-48f4-bbf9-54ccadddc765 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:15.361812 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c002994-e6ce-48f4-bbf9-54ccadddc765 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:15.364616 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c002994-e6ce-48f4-bbf9-54ccadddc765 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:15.473664 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-888949ae-5fbc-4b9d-a27e-52a9fa14d609 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:15.482612 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-888949ae-5fbc-4b9d-a27e-52a9fa14d609 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:15.484163 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-888949ae-5fbc-4b9d-a27e-52a9fa14d609 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:15.578540 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-888949ae-5fbc-4b9d-a27e-52a9fa14d609 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Going to try to stop instance {{(pid=130230) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 18:58:15.598578 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6c002994-e6ce-48f4-bbf9-54ccadddc765 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:15.607016 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6c002994-e6ce-48f4-bbf9-54ccadddc765 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:15.608954 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6c002994-e6ce-48f4-bbf9-54ccadddc765 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:15.610539 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6c002994-e6ce-48f4-bbf9-54ccadddc765 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.268393 Jun 16 18:58:15.621678 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 155/291] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:15 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:15.758992 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-888949ae-5fbc-4b9d-a27e-52a9fa14d609 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "POST /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/action" status: 202 len: 0 microversion: 2.1 time: 0.286330 Jun 16 18:58:15.758992 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 137/292] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jun 16 18:58:15 2022] POST /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:58:15.765564 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-90ef05a9-90af-4314-8f2a-8a110bc02670 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:15.766242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-90ef05a9-90af-4314-8f2a-8a110bc02670 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:15.773845 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-90ef05a9-90af-4314-8f2a-8a110bc02670 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:15.780502 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-90ef05a9-90af-4314-8f2a-8a110bc02670 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:15.781975 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-90ef05a9-90af-4314-8f2a-8a110bc02670 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:15.782584 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-90ef05a9-90af-4314-8f2a-8a110bc02670 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:15.797148 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-07c1b6f3-d744-4d20-86f5-3e0973767608 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:15.798279 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-07c1b6f3-d744-4d20-86f5-3e0973767608 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:15.819620 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-07c1b6f3-d744-4d20-86f5-3e0973767608 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:15.820335 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-07c1b6f3-d744-4d20-86f5-3e0973767608 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:15.821469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-07c1b6f3-d744-4d20-86f5-3e0973767608 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:15.822193 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-07c1b6f3-d744-4d20-86f5-3e0973767608 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:15.976500 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-07c1b6f3-d744-4d20-86f5-3e0973767608 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:15.984880 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-07c1b6f3-d744-4d20-86f5-3e0973767608 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1204 microversion: 2.1 time: 0.193776 Jun 16 18:58:15.986038 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 138/293] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:15 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1204 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:15.991119 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-769a0311-9474-4d52-9b0c-b9ca91a8fc12 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:15.992084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-769a0311-9474-4d52-9b0c-b9ca91a8fc12 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:16.001290 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-769a0311-9474-4d52-9b0c-b9ca91a8fc12 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:16.002051 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-769a0311-9474-4d52-9b0c-b9ca91a8fc12 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:16.003164 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-769a0311-9474-4d52-9b0c-b9ca91a8fc12 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:16.003786 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-769a0311-9474-4d52-9b0c-b9ca91a8fc12 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:16.047293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-90ef05a9-90af-4314-8f2a-8a110bc02670 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:16.065745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-90ef05a9-90af-4314-8f2a-8a110bc02670 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.304289 Jun 16 18:58:16.066631 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 156/294] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:15 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:16.167438 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-769a0311-9474-4d52-9b0c-b9ca91a8fc12 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:16.189592 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-769a0311-9474-4d52-9b0c-b9ca91a8fc12 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1318 microversion: 2.1 time: 0.190144 Jun 16 18:58:16.189592 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 139/295] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:15 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:16.490137 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-60782212", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f034df0-3327-47b9-8a71-7606258bf90a"}], "security_groups": [{"name": "tempest-securitygroup--1249668510"}], "key_name": "tempest-keypair-281560677", "user_data": "}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:16.618816 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.network.neutron [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] validate_networks() for [('9f034df0-3327-47b9-8a71-7606258bf90a', None, None, None, None, None)] {{(pid=130229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:58:16.629074 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d12c3291-131a-4ac0-b958-aeff5f1a7e4a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:16.633079 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d12c3291-131a-4ac0-b958-aeff5f1a7e4a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:16.646939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d12c3291-131a-4ac0-b958-aeff5f1a7e4a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:16.656667 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d12c3291-131a-4ac0-b958-aeff5f1a7e4a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:16.657123 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d12c3291-131a-4ac0-b958-aeff5f1a7e4a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:16.657921 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d12c3291-131a-4ac0-b958-aeff5f1a7e4a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:16.881616 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d12c3291-131a-4ac0-b958-aeff5f1a7e4a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:16.893642 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d12c3291-131a-4ac0-b958-aeff5f1a7e4a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:16.895596 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d12c3291-131a-4ac0-b958-aeff5f1a7e4a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:16.897514 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d12c3291-131a-4ac0-b958-aeff5f1a7e4a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.273378 Jun 16 18:58:16.899815 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 140/296] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:16 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:17.010976 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-007e430e-bfea-413e-9933-dcaa28227685 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:17.011582 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-007e430e-bfea-413e-9933-dcaa28227685 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:17.020304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-007e430e-bfea-413e-9933-dcaa28227685 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:17.026716 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-007e430e-bfea-413e-9933-dcaa28227685 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:17.026716 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-007e430e-bfea-413e-9933-dcaa28227685 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:17.026716 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-007e430e-bfea-413e-9933-dcaa28227685 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:17.283372 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-007e430e-bfea-413e-9933-dcaa28227685 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:17.312689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Flavor limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:58:17.313857 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Image limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:58:17.314299 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Flavor pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:58:17.314719 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Image pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:58:17.315137 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:58:17.325473 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-007e430e-bfea-413e-9933-dcaa28227685 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1271 microversion: 2.1 time: 0.322625 Jun 16 18:58:17.326406 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 141/297] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:16 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1271 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:17.335661 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:17.335661 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:17.339575 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:17.340099 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:17.349377 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e6d5f186-fb6e-4534-9442-cb66bd2877ae tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:17.350353 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e6d5f186-fb6e-4534-9442-cb66bd2877ae tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:17.371765 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e6d5f186-fb6e-4534-9442-cb66bd2877ae tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:17.372550 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e6d5f186-fb6e-4534-9442-cb66bd2877ae tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:17.373591 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e6d5f186-fb6e-4534-9442-cb66bd2877ae tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:17.374185 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e6d5f186-fb6e-4534-9442-cb66bd2877ae tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:17.378212 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Getting quotas for project ed8501d1ff734054ba0a6ef4c398d051. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:58:17.383720 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Getting quotas for user 7310c631282c495a83e17dbdbc6d2ba0 and project ed8501d1ff734054ba0a6ef4c398d051. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:58:17.400457 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Going to run 1 instances... {{(pid=130229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:58:17.404931 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:58:17.533906 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e6d5f186-fb6e-4534-9442-cb66bd2877ae tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:17.542555 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e6d5f186-fb6e-4534-9442-cb66bd2877ae tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.203742 Jun 16 18:58:17.553589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 142/298] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:17 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:17.563039 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-80ab4ce3-055e-4ff5-b6fb-3dbd570574f6 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.073966 Jun 16 18:58:17.563314 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-8b5e6c9f-6755-4693-91aa-9dd17d7037b0 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:17.564111 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-8b5e6c9f-6755-4693-91aa-9dd17d7037b0 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:17.564689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 157/299] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 18:58:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:58:17.579615 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8b5e6c9f-6755-4693-91aa-9dd17d7037b0 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:17.581714 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8b5e6c9f-6755-4693-91aa-9dd17d7037b0 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:17.587266 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8b5e6c9f-6755-4693-91aa-9dd17d7037b0 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:17.588207 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0340b56f-1738-4260-b078-ca0e80ff1b7a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:17.588315 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8b5e6c9f-6755-4693-91aa-9dd17d7037b0 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:17.588406 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0340b56f-1738-4260-b078-ca0e80ff1b7a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:17.790475 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0340b56f-1738-4260-b078-ca0e80ff1b7a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:17.806805 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0340b56f-1738-4260-b078-ca0e80ff1b7a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1243 microversion: 2.1 time: 0.232388 Jun 16 18:58:17.820199 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 158/300] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:17 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1243 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:17.917773 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a3c932b1-a82b-405f-8501-1d06e602414e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:17.918846 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a3c932b1-a82b-405f-8501-1d06e602414e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:17.927435 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a3c932b1-a82b-405f-8501-1d06e602414e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:17.933472 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a3c932b1-a82b-405f-8501-1d06e602414e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:17.933472 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a3c932b1-a82b-405f-8501-1d06e602414e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:17.933472 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a3c932b1-a82b-405f-8501-1d06e602414e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:17.934547 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8b5e6c9f-6755-4693-91aa-9dd17d7037b0 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:17.948276 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-8b5e6c9f-6755-4693-91aa-9dd17d7037b0 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1318 microversion: 2.1 time: 0.387269 Jun 16 18:58:17.951686 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 143/301] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:17 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:18.072607 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-9254252e-1103-4336-9195-928be1f9b27f req-67b825ad-de2b-449a-8db0-32e297e3b73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5fb9a14-5c4d-4dcd-9728-85313113a15e", "name": "network-vif-plugged", "status": "completed", "tag": "80388b4f-0d36-43aa-8acd-308c5eefc7ba"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:18.085265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-9254252e-1103-4336-9195-928be1f9b27f req-67b825ad-de2b-449a-8db0-32e297e3b73d service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:18.085732 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-9254252e-1103-4336-9195-928be1f9b27f req-67b825ad-de2b-449a-8db0-32e297e3b73d service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:18.115631 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-9254252e-1103-4336-9195-928be1f9b27f req-67b825ad-de2b-449a-8db0-32e297e3b73d service nova] Creating event network-vif-plugged:80388b4f-0d36-43aa-8acd-308c5eefc7ba for instance c5fb9a14-5c4d-4dcd-9728-85313113a15e on hv-cinder-84617 Jun 16 18:58:18.121080 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-9254252e-1103-4336-9195-928be1f9b27f req-67b825ad-de2b-449a-8db0-32e297e3b73d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068397 Jun 16 18:58:18.125621 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 144/302] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:58:18.136724 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a3c932b1-a82b-405f-8501-1d06e602414e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:18.146780 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a3c932b1-a82b-405f-8501-1d06e602414e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:18.148807 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a3c932b1-a82b-405f-8501-1d06e602414e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:18.150527 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a3c932b1-a82b-405f-8501-1d06e602414e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.238465 Jun 16 18:58:18.171270 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 159/303] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:17 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:18.199963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-a96e516a-4bf1-41ca-a255-01b585248bc1 req-133b111f-dde9-4bc1-81e8-9c6ea3f9b584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf1ba63-bf52-412b-9948-409dadbbdf18", "tag": "9d682d40-5577-43db-823b-b6e4729f33b7"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:18.228708 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-a96e516a-4bf1-41ca-a255-01b585248bc1 req-133b111f-dde9-4bc1-81e8-9c6ea3f9b584 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:18.228708 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-a96e516a-4bf1-41ca-a255-01b585248bc1 req-133b111f-dde9-4bc1-81e8-9c6ea3f9b584 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:18.234917 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:18.248157 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-a96e516a-4bf1-41ca-a255-01b585248bc1 req-133b111f-dde9-4bc1-81e8-9c6ea3f9b584 service nova] Creating event network-changed:9d682d40-5577-43db-823b-b6e4729f33b7 for instance 5bf1ba63-bf52-412b-9948-409dadbbdf18 on hv-cinder-84617 Jun 16 18:58:18.262536 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-a96e516a-4bf1-41ca-a255-01b585248bc1 req-133b111f-dde9-4bc1-81e8-9c6ea3f9b584 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067729 Jun 16 18:58:18.271884 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 145/304] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:18.348348 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e06f6086-6eba-4de6-8136-9d0fdf281e9c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:18.351504 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e06f6086-6eba-4de6-8136-9d0fdf281e9c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:18.370631 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e06f6086-6eba-4de6-8136-9d0fdf281e9c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:18.371361 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e06f6086-6eba-4de6-8136-9d0fdf281e9c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:18.374710 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e06f6086-6eba-4de6-8136-9d0fdf281e9c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:18.376550 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e06f6086-6eba-4de6-8136-9d0fdf281e9c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:18.562325 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4b5ca8d9-ee6e-49c9-b72a-f6f8ed086a84 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:18.563673 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4b5ca8d9-ee6e-49c9-b72a-f6f8ed086a84 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:18.590695 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4b5ca8d9-ee6e-49c9-b72a-f6f8ed086a84 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:18.591149 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4b5ca8d9-ee6e-49c9-b72a-f6f8ed086a84 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:18.596065 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4b5ca8d9-ee6e-49c9-b72a-f6f8ed086a84 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:18.596528 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4b5ca8d9-ee6e-49c9-b72a-f6f8ed086a84 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:18.671864 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e06f6086-6eba-4de6-8136-9d0fdf281e9c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:18.679429 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e06f6086-6eba-4de6-8136-9d0fdf281e9c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1259 microversion: 2.1 time: 0.339645 Jun 16 18:58:18.690022 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 160/305] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:18 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1259 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:18.774183 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4b5ca8d9-ee6e-49c9-b72a-f6f8ed086a84 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:18.782731 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4b5ca8d9-ee6e-49c9-b72a-f6f8ed086a84 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.226480 Jun 16 18:58:18.783300 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 146/306] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:18 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:18.827018 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0631c880-d734-431d-9955-beb3fbcd8138 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:18.827645 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0631c880-d734-431d-9955-beb3fbcd8138 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:18.881018 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0631c880-d734-431d-9955-beb3fbcd8138 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:18.889992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0631c880-d734-431d-9955-beb3fbcd8138 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1243 microversion: 2.1 time: 0.066101 Jun 16 18:58:18.891491 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 161/307] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:18 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1243 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:18.973149 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-304c2f18-a390-4c4d-8b9c-07ed08ed6ca8 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:18.973803 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-304c2f18-a390-4c4d-8b9c-07ed08ed6ca8 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:18.981962 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-304c2f18-a390-4c4d-8b9c-07ed08ed6ca8 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:18.982635 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-304c2f18-a390-4c4d-8b9c-07ed08ed6ca8 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:18.983415 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-304c2f18-a390-4c4d-8b9c-07ed08ed6ca8 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:18.983901 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-304c2f18-a390-4c4d-8b9c-07ed08ed6ca8 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:19.152015 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-304c2f18-a390-4c4d-8b9c-07ed08ed6ca8 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:19.158945 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-304c2f18-a390-4c4d-8b9c-07ed08ed6ca8 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1318 microversion: 2.1 time: 0.194180 Jun 16 18:58:19.159527 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 147/308] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:18 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:19.173562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8e276f8f-f8ea-4d5d-918c-95a4e1af87f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:19.176710 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8e276f8f-f8ea-4d5d-918c-95a4e1af87f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:19.181193 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8e276f8f-f8ea-4d5d-918c-95a4e1af87f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:19.181947 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8e276f8f-f8ea-4d5d-918c-95a4e1af87f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:19.182808 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8e276f8f-f8ea-4d5d-918c-95a4e1af87f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:19.183305 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8e276f8f-f8ea-4d5d-918c-95a4e1af87f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:19.525462 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8e276f8f-f8ea-4d5d-918c-95a4e1af87f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:19.534896 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8e276f8f-f8ea-4d5d-918c-95a4e1af87f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:19.536558 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8e276f8f-f8ea-4d5d-918c-95a4e1af87f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:19.537810 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8e276f8f-f8ea-4d5d-918c-95a4e1af87f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.371955 Jun 16 18:58:19.538476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 162/309] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:19 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:19.700567 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-8744f1b4-3bb3-498b-8230-e42f608cdffe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:19.701226 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-8744f1b4-3bb3-498b-8230-e42f608cdffe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:19.711631 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8744f1b4-3bb3-498b-8230-e42f608cdffe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:19.712416 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8744f1b4-3bb3-498b-8230-e42f608cdffe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:19.714505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8744f1b4-3bb3-498b-8230-e42f608cdffe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:19.714945 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8744f1b4-3bb3-498b-8230-e42f608cdffe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:19.799877 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-10b65288-0f96-481c-a9f9-96a4b4667545 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:19.800763 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-10b65288-0f96-481c-a9f9-96a4b4667545 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:19.807537 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10b65288-0f96-481c-a9f9-96a4b4667545 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:19.808046 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10b65288-0f96-481c-a9f9-96a4b4667545 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:19.808760 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10b65288-0f96-481c-a9f9-96a4b4667545 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:19.809428 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10b65288-0f96-481c-a9f9-96a4b4667545 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:19.906285 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8744f1b4-3bb3-498b-8230-e42f608cdffe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:19.915725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-8744f1b4-3bb3-498b-8230-e42f608cdffe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1259 microversion: 2.1 time: 0.222305 Jun 16 18:58:19.926939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 148/310] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:19 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:19.932352 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-95b437cb-21f7-489f-b9a2-2f10e80bedce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:19.933376 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-95b437cb-21f7-489f-b9a2-2f10e80bedce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:19.939768 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-95b437cb-21f7-489f-b9a2-2f10e80bedce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:19.940535 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-95b437cb-21f7-489f-b9a2-2f10e80bedce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:19.941629 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-95b437cb-21f7-489f-b9a2-2f10e80bedce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:19.942483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-95b437cb-21f7-489f-b9a2-2f10e80bedce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:20.016644 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-95b437cb-21f7-489f-b9a2-2f10e80bedce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:20.024779 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-95b437cb-21f7-489f-b9a2-2f10e80bedce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1295 microversion: 2.1 time: 0.096290 Jun 16 18:58:20.026791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-10b65288-0f96-481c-a9f9-96a4b4667545 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:20.034697 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 149/311] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:19 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1295 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:20.040788 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-10b65288-0f96-481c-a9f9-96a4b4667545 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.244660 Jun 16 18:58:20.045340 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 163/312] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:19 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:20.176914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e51975b6-d0cd-4f05-8c3f-fdd393801219 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:20.177547 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e51975b6-d0cd-4f05-8c3f-fdd393801219 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:20.183702 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e51975b6-d0cd-4f05-8c3f-fdd393801219 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:20.184179 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e51975b6-d0cd-4f05-8c3f-fdd393801219 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:20.184978 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e51975b6-d0cd-4f05-8c3f-fdd393801219 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:20.185442 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e51975b6-d0cd-4f05-8c3f-fdd393801219 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:20.374615 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e51975b6-d0cd-4f05-8c3f-fdd393801219 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:20.383991 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e51975b6-d0cd-4f05-8c3f-fdd393801219 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1507 microversion: 2.1 time: 0.211881 Jun 16 18:58:20.384588 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 150/313] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:20 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:20.556455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4cf2a561-7cc4-4edf-a91d-9c79103d8b0f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:20.558018 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4cf2a561-7cc4-4edf-a91d-9c79103d8b0f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:20.565369 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4cf2a561-7cc4-4edf-a91d-9c79103d8b0f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:20.565925 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4cf2a561-7cc4-4edf-a91d-9c79103d8b0f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:20.566834 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4cf2a561-7cc4-4edf-a91d-9c79103d8b0f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:20.567408 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4cf2a561-7cc4-4edf-a91d-9c79103d8b0f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:20.717889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4cf2a561-7cc4-4edf-a91d-9c79103d8b0f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:20.726354 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4cf2a561-7cc4-4edf-a91d-9c79103d8b0f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:20.729702 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4cf2a561-7cc4-4edf-a91d-9c79103d8b0f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:20.732041 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4cf2a561-7cc4-4edf-a91d-9c79103d8b0f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.178834 Jun 16 18:58:20.732041 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 164/314] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:20 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:20.931970 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-8e0f1398-1939-47b2-a3ad-d34208b3dbfe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:20.932603 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-8e0f1398-1939-47b2-a3ad-d34208b3dbfe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:20.934772 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:20.940078 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8e0f1398-1939-47b2-a3ad-d34208b3dbfe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:20.940528 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8e0f1398-1939-47b2-a3ad-d34208b3dbfe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:20.941528 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8e0f1398-1939-47b2-a3ad-d34208b3dbfe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:20.941972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8e0f1398-1939-47b2-a3ad-d34208b3dbfe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:21.043499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e35e8695-3a91-4476-93dd-b27c6aa436e3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:21.044141 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e35e8695-3a91-4476-93dd-b27c6aa436e3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:21.050601 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e35e8695-3a91-4476-93dd-b27c6aa436e3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:21.051264 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e35e8695-3a91-4476-93dd-b27c6aa436e3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:21.052040 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e35e8695-3a91-4476-93dd-b27c6aa436e3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:21.052555 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e35e8695-3a91-4476-93dd-b27c6aa436e3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:21.088879 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8e0f1398-1939-47b2-a3ad-d34208b3dbfe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:21.096540 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-8e0f1398-1939-47b2-a3ad-d34208b3dbfe tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1259 microversion: 2.1 time: 0.168453 Jun 16 18:58:21.097217 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 151/315] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:20 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:21.102229 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-436c485a-644e-44d6-b10e-3319b883fb7c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:21.103054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-436c485a-644e-44d6-b10e-3319b883fb7c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:21.109644 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-436c485a-644e-44d6-b10e-3319b883fb7c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:21.110352 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-436c485a-644e-44d6-b10e-3319b883fb7c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:21.111159 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-436c485a-644e-44d6-b10e-3319b883fb7c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:21.111648 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-436c485a-644e-44d6-b10e-3319b883fb7c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:21.145215 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e35e8695-3a91-4476-93dd-b27c6aa436e3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:21.153803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e35e8695-3a91-4476-93dd-b27c6aa436e3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1295 microversion: 2.1 time: 0.114722 Jun 16 18:58:21.157688 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 165/316] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:21 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1295 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:21.288615 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-436c485a-644e-44d6-b10e-3319b883fb7c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:21.296796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-436c485a-644e-44d6-b10e-3319b883fb7c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.198423 Jun 16 18:58:21.298192 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 152/317] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:21 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:21.750424 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6342098b-4d22-41d1-9647-0c882579732a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:21.751870 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6342098b-4d22-41d1-9647-0c882579732a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:21.758617 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6342098b-4d22-41d1-9647-0c882579732a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:21.759038 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6342098b-4d22-41d1-9647-0c882579732a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:21.759800 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6342098b-4d22-41d1-9647-0c882579732a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:21.760430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6342098b-4d22-41d1-9647-0c882579732a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:21.908060 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6342098b-4d22-41d1-9647-0c882579732a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:21.917852 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6342098b-4d22-41d1-9647-0c882579732a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:21.919401 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6342098b-4d22-41d1-9647-0c882579732a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:21.920582 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6342098b-4d22-41d1-9647-0c882579732a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.174754 Jun 16 18:58:21.921145 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 166/318] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:21 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:22.113577 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-71e86fa6-ffc2-4265-9458-ca654b8741ce tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:22.114113 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-71e86fa6-ffc2-4265-9458-ca654b8741ce tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:22.120879 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-71e86fa6-ffc2-4265-9458-ca654b8741ce tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:22.121356 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-71e86fa6-ffc2-4265-9458-ca654b8741ce tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:22.123281 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-71e86fa6-ffc2-4265-9458-ca654b8741ce tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:22.123281 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-71e86fa6-ffc2-4265-9458-ca654b8741ce tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:22.173719 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-532fa900-8922-412c-823d-040f9cdb4e49 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:22.175417 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-532fa900-8922-412c-823d-040f9cdb4e49 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:22.186054 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-532fa900-8922-412c-823d-040f9cdb4e49 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:22.186871 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-532fa900-8922-412c-823d-040f9cdb4e49 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:22.192127 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-532fa900-8922-412c-823d-040f9cdb4e49 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:22.192720 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-532fa900-8922-412c-823d-040f9cdb4e49 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:22.283410 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-532fa900-8922-412c-823d-040f9cdb4e49 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:22.292296 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-532fa900-8922-412c-823d-040f9cdb4e49 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1301 microversion: 2.1 time: 0.124058 Jun 16 18:58:22.292925 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 167/319] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:22 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1301 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:22.311126 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-71e86fa6-ffc2-4265-9458-ca654b8741ce tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:22.314060 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-74c565bb-ce9a-435a-a750-ec8381afec89 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:22.314709 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-74c565bb-ce9a-435a-a750-ec8381afec89 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:22.320897 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-71e86fa6-ffc2-4265-9458-ca654b8741ce tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1259 microversion: 2.1 time: 0.211186 Jun 16 18:58:22.326270 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-74c565bb-ce9a-435a-a750-ec8381afec89 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:22.326722 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-74c565bb-ce9a-435a-a750-ec8381afec89 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:22.327494 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-74c565bb-ce9a-435a-a750-ec8381afec89 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:22.328098 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-74c565bb-ce9a-435a-a750-ec8381afec89 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:22.330672 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 153/320] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:22 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:22.474538 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-74c565bb-ce9a-435a-a750-ec8381afec89 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:22.483917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-74c565bb-ce9a-435a-a750-ec8381afec89 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.173715 Jun 16 18:58:22.484501 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 168/321] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:22 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:22.939548 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-8f8d38e6-c5a9-4ed0-a4ec-fa918eec9979 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:22.940199 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-8f8d38e6-c5a9-4ed0-a4ec-fa918eec9979 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:22.946331 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8f8d38e6-c5a9-4ed0-a4ec-fa918eec9979 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:22.946854 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8f8d38e6-c5a9-4ed0-a4ec-fa918eec9979 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:22.947728 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8f8d38e6-c5a9-4ed0-a4ec-fa918eec9979 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:22.948235 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8f8d38e6-c5a9-4ed0-a4ec-fa918eec9979 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:23.094089 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8f8d38e6-c5a9-4ed0-a4ec-fa918eec9979 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:23.104349 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8f8d38e6-c5a9-4ed0-a4ec-fa918eec9979 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:23.105927 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8f8d38e6-c5a9-4ed0-a4ec-fa918eec9979 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:23.107371 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-8f8d38e6-c5a9-4ed0-a4ec-fa918eec9979 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.171937 Jun 16 18:58:23.107929 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 154/322] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:22 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:23.309461 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c2069aa4-94a8-4a31-a67e-f599ae59d045 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:23.310140 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c2069aa4-94a8-4a31-a67e-f599ae59d045 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:23.319031 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c2069aa4-94a8-4a31-a67e-f599ae59d045 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:23.319489 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c2069aa4-94a8-4a31-a67e-f599ae59d045 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:23.320295 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c2069aa4-94a8-4a31-a67e-f599ae59d045 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:23.320709 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c2069aa4-94a8-4a31-a67e-f599ae59d045 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:23.325142 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=100 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:23.337736 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-03022d6b-37a8-42d3-ac2f-75f989c532f1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:23.344105 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-03022d6b-37a8-42d3-ac2f-75f989c532f1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:23.350352 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=12 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:23.352419 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-03022d6b-37a8-42d3-ac2f-75f989c532f1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:23.352977 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-03022d6b-37a8-42d3-ac2f-75f989c532f1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:23.353998 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-03022d6b-37a8-42d3-ac2f-75f989c532f1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:23.364604 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-03022d6b-37a8-42d3-ac2f-75f989c532f1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:23.638736 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c2069aa4-94a8-4a31-a67e-f599ae59d045 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:23.649212 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c2069aa4-94a8-4a31-a67e-f599ae59d045 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1369 microversion: 2.1 time: 0.343564 Jun 16 18:58:23.667845 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 169/323] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:23 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1369 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:23.671508 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-714e95f0-3117-403a-bee8-f421ef5f6aeb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:23.673221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-714e95f0-3117-403a-bee8-f421ef5f6aeb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:23.681535 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-714e95f0-3117-403a-bee8-f421ef5f6aeb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:23.688973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-714e95f0-3117-403a-bee8-f421ef5f6aeb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:23.690161 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-714e95f0-3117-403a-bee8-f421ef5f6aeb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:23.691793 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-714e95f0-3117-403a-bee8-f421ef5f6aeb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:23.712486 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-03022d6b-37a8-42d3-ac2f-75f989c532f1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:23.725697 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-03022d6b-37a8-42d3-ac2f-75f989c532f1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1259 microversion: 2.1 time: 0.391615 Jun 16 18:58:23.726310 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 155/324] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:23 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1259 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:23.745771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-02b16068-0a47-4c2f-8072-b8dad4070563 req-a74bc09d-1d59-4e01-9d02-3a0f81a14c85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88123824-1b55-41ca-a29f-0d3e0edd3d1d", "tag": "2fb01582-cf21-44de-8d3e-18570d242041"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:23.769374 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-02b16068-0a47-4c2f-8072-b8dad4070563 req-a74bc09d-1d59-4e01-9d02-3a0f81a14c85 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:23.770078 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-02b16068-0a47-4c2f-8072-b8dad4070563 req-a74bc09d-1d59-4e01-9d02-3a0f81a14c85 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:23.788877 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-02b16068-0a47-4c2f-8072-b8dad4070563 req-a74bc09d-1d59-4e01-9d02-3a0f81a14c85 service nova] Creating event network-changed:2fb01582-cf21-44de-8d3e-18570d242041 for instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d on hv-cinder-84617 Jun 16 18:58:23.794035 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-02b16068-0a47-4c2f-8072-b8dad4070563 req-a74bc09d-1d59-4e01-9d02-3a0f81a14c85 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064506 Jun 16 18:58:23.794641 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 156/325] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:23.886622 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-714e95f0-3117-403a-bee8-f421ef5f6aeb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:23.900165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-714e95f0-3117-403a-bee8-f421ef5f6aeb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.235175 Jun 16 18:58:23.901368 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 170/326] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:23 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:24.127979 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-79fe52d6-128a-4ae2-adaa-a74d22605139 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:24.128696 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-79fe52d6-128a-4ae2-adaa-a74d22605139 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:24.135003 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-79fe52d6-128a-4ae2-adaa-a74d22605139 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:24.135456 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-79fe52d6-128a-4ae2-adaa-a74d22605139 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:24.136814 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-79fe52d6-128a-4ae2-adaa-a74d22605139 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:24.137274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-79fe52d6-128a-4ae2-adaa-a74d22605139 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:24.308228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-79fe52d6-128a-4ae2-adaa-a74d22605139 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:24.316674 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-79fe52d6-128a-4ae2-adaa-a74d22605139 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:24.318517 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-79fe52d6-128a-4ae2-adaa-a74d22605139 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:24.319717 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-79fe52d6-128a-4ae2-adaa-a74d22605139 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.196060 Jun 16 18:58:24.320608 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 157/327] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:24 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:24.666781 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ebf1a53d-cb8a-4815-8a56-ac6303d7deb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:24.667930 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ebf1a53d-cb8a-4815-8a56-ac6303d7deb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:24.673871 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ebf1a53d-cb8a-4815-8a56-ac6303d7deb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:24.674309 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ebf1a53d-cb8a-4815-8a56-ac6303d7deb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:24.675061 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ebf1a53d-cb8a-4815-8a56-ac6303d7deb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:24.675497 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ebf1a53d-cb8a-4815-8a56-ac6303d7deb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:24.749087 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-14a4707c-aa99-4a09-b865-7e95a3695063 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:24.750528 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-14a4707c-aa99-4a09-b865-7e95a3695063 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:24.763369 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:24.763369 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-14a4707c-aa99-4a09-b865-7e95a3695063 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:24.763369 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-14a4707c-aa99-4a09-b865-7e95a3695063 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:24.763369 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-14a4707c-aa99-4a09-b865-7e95a3695063 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:24.763729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-14a4707c-aa99-4a09-b865-7e95a3695063 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:24.862412 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ebf1a53d-cb8a-4815-8a56-ac6303d7deb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:24.874434 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ebf1a53d-cb8a-4815-8a56-ac6303d7deb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1369 microversion: 2.1 time: 0.211398 Jun 16 18:58:24.875039 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 171/328] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:24 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1369 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:24.918756 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6b3ac3bb-bd38-4126-9962-2f10a29c0937 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:24.919538 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6b3ac3bb-bd38-4126-9962-2f10a29c0937 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:24.925792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6b3ac3bb-bd38-4126-9962-2f10a29c0937 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:24.926355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6b3ac3bb-bd38-4126-9962-2f10a29c0937 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:24.927209 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6b3ac3bb-bd38-4126-9962-2f10a29c0937 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:24.927763 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6b3ac3bb-bd38-4126-9962-2f10a29c0937 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:24.946660 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-14a4707c-aa99-4a09-b865-7e95a3695063 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:24.956039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-14a4707c-aa99-4a09-b865-7e95a3695063 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1259 microversion: 2.1 time: 0.212001 Jun 16 18:58:24.956981 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 158/329] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:24 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:25.061872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6b3ac3bb-bd38-4126-9962-2f10a29c0937 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:25.073208 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6b3ac3bb-bd38-4126-9962-2f10a29c0937 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.158808 Jun 16 18:58:25.073873 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 172/330] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:24 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:25.339872 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ef8ce41c-1345-44c5-ba9b-cb9f58a6d941 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:25.340498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ef8ce41c-1345-44c5-ba9b-cb9f58a6d941 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:25.349691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ef8ce41c-1345-44c5-ba9b-cb9f58a6d941 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:25.350149 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ef8ce41c-1345-44c5-ba9b-cb9f58a6d941 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:25.350943 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ef8ce41c-1345-44c5-ba9b-cb9f58a6d941 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:25.352629 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ef8ce41c-1345-44c5-ba9b-cb9f58a6d941 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:25.501076 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ef8ce41c-1345-44c5-ba9b-cb9f58a6d941 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:25.509936 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ef8ce41c-1345-44c5-ba9b-cb9f58a6d941 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:25.512063 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ef8ce41c-1345-44c5-ba9b-cb9f58a6d941 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:25.513226 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ef8ce41c-1345-44c5-ba9b-cb9f58a6d941 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.178192 Jun 16 18:58:25.522685 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 159/331] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:25 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:25.895809 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ff7bbd64-9a92-49aa-82e7-071c926c1a78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:25.896561 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ff7bbd64-9a92-49aa-82e7-071c926c1a78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:25.904250 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff7bbd64-9a92-49aa-82e7-071c926c1a78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:25.904684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff7bbd64-9a92-49aa-82e7-071c926c1a78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:25.905494 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff7bbd64-9a92-49aa-82e7-071c926c1a78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:25.905935 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff7bbd64-9a92-49aa-82e7-071c926c1a78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:25.975552 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-75068bda-748e-4c1c-a4b0-d875a4876fb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:25.976090 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-75068bda-748e-4c1c-a4b0-d875a4876fb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:25.982790 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-75068bda-748e-4c1c-a4b0-d875a4876fb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:25.983751 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-75068bda-748e-4c1c-a4b0-d875a4876fb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:25.984557 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-75068bda-748e-4c1c-a4b0-d875a4876fb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:25.984999 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-75068bda-748e-4c1c-a4b0-d875a4876fb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:26.080166 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ff7bbd64-9a92-49aa-82e7-071c926c1a78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:26.094625 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ff7bbd64-9a92-49aa-82e7-071c926c1a78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1369 microversion: 2.1 time: 0.203605 Jun 16 18:58:26.104660 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 173/332] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:25 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1369 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:26.110427 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-958d9372-1d9f-4f18-bfa0-86bc9541ea5b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:26.115957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-958d9372-1d9f-4f18-bfa0-86bc9541ea5b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:26.118123 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-958d9372-1d9f-4f18-bfa0-86bc9541ea5b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:26.118572 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-958d9372-1d9f-4f18-bfa0-86bc9541ea5b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:26.119662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-958d9372-1d9f-4f18-bfa0-86bc9541ea5b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:26.120685 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-958d9372-1d9f-4f18-bfa0-86bc9541ea5b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:26.150469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-75068bda-748e-4c1c-a4b0-d875a4876fb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:26.150469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-75068bda-748e-4c1c-a4b0-d875a4876fb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1259 microversion: 2.1 time: 0.176632 Jun 16 18:58:26.150469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 160/333] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:25 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:26.265441 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-958d9372-1d9f-4f18-bfa0-86bc9541ea5b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:26.273567 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-958d9372-1d9f-4f18-bfa0-86bc9541ea5b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.167370 Jun 16 18:58:26.274123 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 174/334] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:26 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:26.535398 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c00e58a9-90ec-46dd-8476-769c893e4de0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:26.535398 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-c00e58a9-90ec-46dd-8476-769c893e4de0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:26.539084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c00e58a9-90ec-46dd-8476-769c893e4de0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:26.539534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c00e58a9-90ec-46dd-8476-769c893e4de0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:26.540293 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c00e58a9-90ec-46dd-8476-769c893e4de0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:26.540728 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c00e58a9-90ec-46dd-8476-769c893e4de0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:26.677499 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c00e58a9-90ec-46dd-8476-769c893e4de0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:26.686307 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c00e58a9-90ec-46dd-8476-769c893e4de0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:26.690952 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c00e58a9-90ec-46dd-8476-769c893e4de0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:26.690952 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-c00e58a9-90ec-46dd-8476-769c893e4de0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.161094 Jun 16 18:58:26.690952 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 161/335] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:26 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:27.112791 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-12b611ae-0f99-45f4-950f-21155c54f67b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:27.113527 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-12b611ae-0f99-45f4-950f-21155c54f67b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:27.120360 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-12b611ae-0f99-45f4-950f-21155c54f67b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:27.120814 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-12b611ae-0f99-45f4-950f-21155c54f67b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:27.121656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-12b611ae-0f99-45f4-950f-21155c54f67b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:27.122097 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-12b611ae-0f99-45f4-950f-21155c54f67b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:27.166908 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-29f49b4f-0c48-4efd-8955-70b329d3d07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:27.167541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-29f49b4f-0c48-4efd-8955-70b329d3d07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:27.175381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29f49b4f-0c48-4efd-8955-70b329d3d07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:27.176085 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29f49b4f-0c48-4efd-8955-70b329d3d07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:27.177335 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29f49b4f-0c48-4efd-8955-70b329d3d07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:27.177785 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29f49b4f-0c48-4efd-8955-70b329d3d07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:27.316549 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-12b611ae-0f99-45f4-950f-21155c54f67b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:27.326114 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-12b611ae-0f99-45f4-950f-21155c54f67b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1369 microversion: 2.1 time: 0.217136 Jun 16 18:58:27.326684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 175/336] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:27 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:27.338302 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-19126b99-9bdc-41d3-8590-3562e6154eee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:27.338983 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-19126b99-9bdc-41d3-8590-3562e6154eee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:27.351939 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-19126b99-9bdc-41d3-8590-3562e6154eee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:27.352775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-29f49b4f-0c48-4efd-8955-70b329d3d07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:27.352934 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-19126b99-9bdc-41d3-8590-3562e6154eee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:27.353738 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-19126b99-9bdc-41d3-8590-3562e6154eee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:27.354476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-19126b99-9bdc-41d3-8590-3562e6154eee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:27.354920 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:27.363143 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-29f49b4f-0c48-4efd-8955-70b329d3d07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1259 microversion: 2.1 time: 0.200512 Jun 16 18:58:27.364327 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 162/337] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:27 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:27.498857 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-19126b99-9bdc-41d3-8590-3562e6154eee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:27.506951 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-19126b99-9bdc-41d3-8590-3562e6154eee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.178514 Jun 16 18:58:27.507522 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 176/338] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:27 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:27.708161 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-fae00fcb-914a-49dc-aaa3-eaec0cf33192 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:27.709280 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-fae00fcb-914a-49dc-aaa3-eaec0cf33192 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:27.718465 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fae00fcb-914a-49dc-aaa3-eaec0cf33192 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:27.721731 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fae00fcb-914a-49dc-aaa3-eaec0cf33192 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:27.721731 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fae00fcb-914a-49dc-aaa3-eaec0cf33192 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:27.721731 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fae00fcb-914a-49dc-aaa3-eaec0cf33192 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:27.749449 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=100 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:27.862793 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-fae00fcb-914a-49dc-aaa3-eaec0cf33192 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:27.871276 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-fae00fcb-914a-49dc-aaa3-eaec0cf33192 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:27.873366 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-fae00fcb-914a-49dc-aaa3-eaec0cf33192 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:27.874535 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-fae00fcb-914a-49dc-aaa3-eaec0cf33192 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1743 microversion: 2.20 time: 0.170598 Jun 16 18:58:27.875757 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 163/339] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:27 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:28.344143 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-dbe52a57-f8d0-43f1-9ad2-bc2496a4dc60 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:28.344954 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-dbe52a57-f8d0-43f1-9ad2-bc2496a4dc60 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:28.351758 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dbe52a57-f8d0-43f1-9ad2-bc2496a4dc60 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:28.352610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dbe52a57-f8d0-43f1-9ad2-bc2496a4dc60 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:28.353610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dbe52a57-f8d0-43f1-9ad2-bc2496a4dc60 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:28.354043 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dbe52a57-f8d0-43f1-9ad2-bc2496a4dc60 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:28.384366 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-0d50f3f9-43a0-4895-8a46-7a67bee01372 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:28.385160 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-0d50f3f9-43a0-4895-8a46-7a67bee01372 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:28.394775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0d50f3f9-43a0-4895-8a46-7a67bee01372 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:28.395303 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0d50f3f9-43a0-4895-8a46-7a67bee01372 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:28.396424 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0d50f3f9-43a0-4895-8a46-7a67bee01372 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:28.397303 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0d50f3f9-43a0-4895-8a46-7a67bee01372 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:28.563581 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-dbe52a57-f8d0-43f1-9ad2-bc2496a4dc60 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:28.572413 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-dbe52a57-f8d0-43f1-9ad2-bc2496a4dc60 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1369 microversion: 2.1 time: 0.233534 Jun 16 18:58:28.573175 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 177/340] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:28 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1369 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:28.582281 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9fe110d6-061f-48c7-9b3a-b1004697123b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:28.583731 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9fe110d6-061f-48c7-9b3a-b1004697123b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:28.590182 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9fe110d6-061f-48c7-9b3a-b1004697123b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:28.591092 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9fe110d6-061f-48c7-9b3a-b1004697123b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:28.594675 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-0d50f3f9-43a0-4895-8a46-7a67bee01372 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:28.598874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9fe110d6-061f-48c7-9b3a-b1004697123b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:28.599319 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9fe110d6-061f-48c7-9b3a-b1004697123b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:28.603045 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-0d50f3f9-43a0-4895-8a46-7a67bee01372 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1259 microversion: 2.1 time: 0.223020 Jun 16 18:58:28.603738 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 164/341] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:28 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:28.740404 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9fe110d6-061f-48c7-9b3a-b1004697123b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:28.749269 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9fe110d6-061f-48c7-9b3a-b1004697123b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.172234 Jun 16 18:58:28.749953 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 178/342] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:28 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:28.893546 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b64afbab-99d9-461e-8e7a-837ebdf70d36 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:28.894099 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b64afbab-99d9-461e-8e7a-837ebdf70d36 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:28.900279 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b64afbab-99d9-461e-8e7a-837ebdf70d36 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:28.900743 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b64afbab-99d9-461e-8e7a-837ebdf70d36 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:28.901577 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b64afbab-99d9-461e-8e7a-837ebdf70d36 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:28.902044 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b64afbab-99d9-461e-8e7a-837ebdf70d36 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:29.042802 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b64afbab-99d9-461e-8e7a-837ebdf70d36 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:29.051760 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b64afbab-99d9-461e-8e7a-837ebdf70d36 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:29.053343 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b64afbab-99d9-461e-8e7a-837ebdf70d36 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:29.054506 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b64afbab-99d9-461e-8e7a-837ebdf70d36 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1743 microversion: 2.20 time: 0.165020 Jun 16 18:58:29.055060 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 165/343] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:28 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:29.589788 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7864d45f-9ac5-4d63-8906-b01648d7c00b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:29.590429 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7864d45f-9ac5-4d63-8906-b01648d7c00b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:29.592911 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=16 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:29.597741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7864d45f-9ac5-4d63-8906-b01648d7c00b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:29.598189 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7864d45f-9ac5-4d63-8906-b01648d7c00b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:29.598961 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7864d45f-9ac5-4d63-8906-b01648d7c00b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:29.599478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7864d45f-9ac5-4d63-8906-b01648d7c00b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:29.620146 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4688ff85-52d4-4e73-99ed-99071fcd368b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:29.620762 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4688ff85-52d4-4e73-99ed-99071fcd368b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:29.627170 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4688ff85-52d4-4e73-99ed-99071fcd368b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:29.627629 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4688ff85-52d4-4e73-99ed-99071fcd368b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:29.628398 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4688ff85-52d4-4e73-99ed-99071fcd368b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:29.628838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4688ff85-52d4-4e73-99ed-99071fcd368b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:29.786671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7864d45f-9ac5-4d63-8906-b01648d7c00b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:29.794419 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7864d45f-9ac5-4d63-8906-b01648d7c00b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1369 microversion: 2.1 time: 0.208408 Jun 16 18:58:29.795257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 179/344] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:29 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1369 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:29.804022 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6f4790d2-62a5-4955-a85e-244cac8d8813 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:29.804770 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6f4790d2-62a5-4955-a85e-244cac8d8813 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:29.810849 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6f4790d2-62a5-4955-a85e-244cac8d8813 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:29.811325 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6f4790d2-62a5-4955-a85e-244cac8d8813 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:29.812126 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6f4790d2-62a5-4955-a85e-244cac8d8813 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:29.812570 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6f4790d2-62a5-4955-a85e-244cac8d8813 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:29.813014 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4688ff85-52d4-4e73-99ed-99071fcd368b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:29.820495 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4688ff85-52d4-4e73-99ed-99071fcd368b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1259 microversion: 2.1 time: 0.204238 Jun 16 18:58:29.823540 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 166/345] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:29 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1259 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:29.939496 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6f4790d2-62a5-4955-a85e-244cac8d8813 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:29.947369 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6f4790d2-62a5-4955-a85e-244cac8d8813 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.151017 Jun 16 18:58:29.949675 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 180/346] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:29 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:30.072964 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-477429a7-a846-4e3e-b66a-8f1861a2f25a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:30.073608 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-477429a7-a846-4e3e-b66a-8f1861a2f25a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:30.080175 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-477429a7-a846-4e3e-b66a-8f1861a2f25a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:30.080653 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-477429a7-a846-4e3e-b66a-8f1861a2f25a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:30.081455 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-477429a7-a846-4e3e-b66a-8f1861a2f25a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:30.086094 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-477429a7-a846-4e3e-b66a-8f1861a2f25a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:30.220136 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-477429a7-a846-4e3e-b66a-8f1861a2f25a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:30.231070 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-477429a7-a846-4e3e-b66a-8f1861a2f25a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:30.233471 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-477429a7-a846-4e3e-b66a-8f1861a2f25a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:30.235175 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-477429a7-a846-4e3e-b66a-8f1861a2f25a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1743 microversion: 2.20 time: 0.166184 Jun 16 18:58:30.246618 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 167/347] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:30 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1743 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:30.357424 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-380af7f7-6483-40ae-9cf1-52b8393cb39f req-dcf464e7-a4a4-419b-84fe-830e56a70c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c04798-b061-421b-9b61-db9cce7dace4", "name": "network-vif-plugged", "status": "completed", "tag": "44fe652d-5231-4810-99fa-21c58c429e9c"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:30.366179 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-380af7f7-6483-40ae-9cf1-52b8393cb39f req-dcf464e7-a4a4-419b-84fe-830e56a70c5f service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:30.366932 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-380af7f7-6483-40ae-9cf1-52b8393cb39f req-dcf464e7-a4a4-419b-84fe-830e56a70c5f service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:30.382254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-380af7f7-6483-40ae-9cf1-52b8393cb39f req-dcf464e7-a4a4-419b-84fe-830e56a70c5f service nova] Creating event network-vif-plugged:44fe652d-5231-4810-99fa-21c58c429e9c for instance d6c04798-b061-421b-9b61-db9cce7dace4 on hv-cinder-84617 Jun 16 18:58:30.388691 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-380af7f7-6483-40ae-9cf1-52b8393cb39f req-dcf464e7-a4a4-419b-84fe-830e56a70c5f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035582 Jun 16 18:58:30.389371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 181/348] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:30.811622 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d925c967-5bf2-4d7e-9d29-5fb1fb94c749 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:30.812261 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d925c967-5bf2-4d7e-9d29-5fb1fb94c749 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:30.818716 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d925c967-5bf2-4d7e-9d29-5fb1fb94c749 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:30.819169 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d925c967-5bf2-4d7e-9d29-5fb1fb94c749 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:30.819910 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d925c967-5bf2-4d7e-9d29-5fb1fb94c749 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:30.820338 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d925c967-5bf2-4d7e-9d29-5fb1fb94c749 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:30.839321 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5cccdcc6-8c56-4504-890e-49e72acc47b1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:30.841125 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5cccdcc6-8c56-4504-890e-49e72acc47b1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:30.847473 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5cccdcc6-8c56-4504-890e-49e72acc47b1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:30.848006 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5cccdcc6-8c56-4504-890e-49e72acc47b1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:30.848889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5cccdcc6-8c56-4504-890e-49e72acc47b1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:30.849440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5cccdcc6-8c56-4504-890e-49e72acc47b1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:31.027483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d925c967-5bf2-4d7e-9d29-5fb1fb94c749 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:31.041756 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d925c967-5bf2-4d7e-9d29-5fb1fb94c749 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1369 microversion: 2.1 time: 0.229095 Jun 16 18:58:31.041756 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 168/349] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:30 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1369 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:31.050958 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a147e13f-d186-4c71-a84b-4fefcd0237fc tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:31.051717 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a147e13f-d186-4c71-a84b-4fefcd0237fc tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:31.058277 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a147e13f-d186-4c71-a84b-4fefcd0237fc tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:31.058854 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a147e13f-d186-4c71-a84b-4fefcd0237fc tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:31.059728 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a147e13f-d186-4c71-a84b-4fefcd0237fc tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:31.059890 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5cccdcc6-8c56-4504-890e-49e72acc47b1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:31.060234 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a147e13f-d186-4c71-a84b-4fefcd0237fc tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:31.067421 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5cccdcc6-8c56-4504-890e-49e72acc47b1 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1259 microversion: 2.1 time: 0.232678 Jun 16 18:58:31.069964 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 182/350] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:30 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:31.190371 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a147e13f-d186-4c71-a84b-4fefcd0237fc tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:31.197766 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a147e13f-d186-4c71-a84b-4fefcd0237fc tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.158848 Jun 16 18:58:31.198340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 169/351] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:31 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:31.253182 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-67d442f5-1981-4956-9821-7aee80ed28ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:31.253818 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-67d442f5-1981-4956-9821-7aee80ed28ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:31.259853 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-67d442f5-1981-4956-9821-7aee80ed28ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:31.260304 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-67d442f5-1981-4956-9821-7aee80ed28ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:31.261061 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-67d442f5-1981-4956-9821-7aee80ed28ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:31.261518 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-67d442f5-1981-4956-9821-7aee80ed28ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:31.396019 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-67d442f5-1981-4956-9821-7aee80ed28ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:31.404624 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-67d442f5-1981-4956-9821-7aee80ed28ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:31.406161 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-67d442f5-1981-4956-9821-7aee80ed28ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:31.407324 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-67d442f5-1981-4956-9821-7aee80ed28ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.158005 Jun 16 18:58:31.417432 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 183/352] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:31 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:32.054947 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-96cc9e3e-00d5-432e-ab86-58edc6ee8dad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:32.055521 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-96cc9e3e-00d5-432e-ab86-58edc6ee8dad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:32.062756 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-96cc9e3e-00d5-432e-ab86-58edc6ee8dad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:32.063209 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-96cc9e3e-00d5-432e-ab86-58edc6ee8dad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:32.064041 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-96cc9e3e-00d5-432e-ab86-58edc6ee8dad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:32.064636 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-96cc9e3e-00d5-432e-ab86-58edc6ee8dad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:32.084821 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-22a76d8c-0650-4500-b532-6c1faf7d3d64 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:32.085479 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-22a76d8c-0650-4500-b532-6c1faf7d3d64 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:32.094644 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-22a76d8c-0650-4500-b532-6c1faf7d3d64 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:32.095085 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-22a76d8c-0650-4500-b532-6c1faf7d3d64 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:32.096051 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-22a76d8c-0650-4500-b532-6c1faf7d3d64 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:32.097223 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-22a76d8c-0650-4500-b532-6c1faf7d3d64 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:32.291340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-96cc9e3e-00d5-432e-ab86-58edc6ee8dad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:32.295149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-22a76d8c-0650-4500-b532-6c1faf7d3d64 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:32.302248 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-96cc9e3e-00d5-432e-ab86-58edc6ee8dad tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1369 microversion: 2.1 time: 0.250711 Jun 16 18:58:32.303521 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 170/353] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:32 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1369 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:32.303902 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-22a76d8c-0650-4500-b532-6c1faf7d3d64 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1259 microversion: 2.1 time: 0.222911 Jun 16 18:58:32.305101 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 184/354] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:32 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:32.310802 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b674b3a7-0007-477c-8f90-c6f74ee8fe3c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:32.313018 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b674b3a7-0007-477c-8f90-c6f74ee8fe3c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:32.333139 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b674b3a7-0007-477c-8f90-c6f74ee8fe3c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:32.334527 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b674b3a7-0007-477c-8f90-c6f74ee8fe3c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:32.337883 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b674b3a7-0007-477c-8f90-c6f74ee8fe3c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:32.339024 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b674b3a7-0007-477c-8f90-c6f74ee8fe3c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:32.418938 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-99dec42b-2004-4706-b148-8a7b68a48aa4 req-e38f5b9f-f74c-4d72-928e-5a32d8636629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf1ba63-bf52-412b-9948-409dadbbdf18", "name": "network-vif-plugged", "status": "completed", "tag": "9d682d40-5577-43db-823b-b6e4729f33b7"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:32.424482 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:32.433858 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-99dec42b-2004-4706-b148-8a7b68a48aa4 req-e38f5b9f-f74c-4d72-928e-5a32d8636629 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:32.434983 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-99dec42b-2004-4706-b148-8a7b68a48aa4 req-e38f5b9f-f74c-4d72-928e-5a32d8636629 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:32.452845 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-99dec42b-2004-4706-b148-8a7b68a48aa4 req-e38f5b9f-f74c-4d72-928e-5a32d8636629 service nova] Creating event network-vif-plugged:9d682d40-5577-43db-823b-b6e4729f33b7 for instance 5bf1ba63-bf52-412b-9948-409dadbbdf18 on hv-cinder-84617 Jun 16 18:58:32.458480 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-99dec42b-2004-4706-b148-8a7b68a48aa4 req-e38f5b9f-f74c-4d72-928e-5a32d8636629 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043557 Jun 16 18:58:32.459201 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 185/355] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:58:32.465094 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d9499f16-5702-412b-b0c3-7cda9607bf85 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:32.468679 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d9499f16-5702-412b-b0c3-7cda9607bf85 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:32.472383 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d9499f16-5702-412b-b0c3-7cda9607bf85 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:32.472930 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d9499f16-5702-412b-b0c3-7cda9607bf85 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:32.473846 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d9499f16-5702-412b-b0c3-7cda9607bf85 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:32.474479 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d9499f16-5702-412b-b0c3-7cda9607bf85 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:32.539664 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b674b3a7-0007-477c-8f90-c6f74ee8fe3c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:32.549490 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b674b3a7-0007-477c-8f90-c6f74ee8fe3c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.243488 Jun 16 18:58:32.550405 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 171/356] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:32 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:32.635256 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d9499f16-5702-412b-b0c3-7cda9607bf85 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:32.643249 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d9499f16-5702-412b-b0c3-7cda9607bf85 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:32.644760 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d9499f16-5702-412b-b0c3-7cda9607bf85 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:32.645935 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d9499f16-5702-412b-b0c3-7cda9607bf85 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.185363 Jun 16 18:58:32.646500 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 186/357] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:32 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:33.323057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2b94002d-e9a9-4f1d-82c9-3737efe2e601 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:33.323700 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2b94002d-e9a9-4f1d-82c9-3737efe2e601 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:33.331205 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2b94002d-e9a9-4f1d-82c9-3737efe2e601 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:33.331658 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2b94002d-e9a9-4f1d-82c9-3737efe2e601 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:33.332416 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-44235628-1234-45f3-b3b1-e72d006fef6a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:33.332842 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2b94002d-e9a9-4f1d-82c9-3737efe2e601 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:33.332842 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2b94002d-e9a9-4f1d-82c9-3737efe2e601 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:33.333062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-44235628-1234-45f3-b3b1-e72d006fef6a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:33.339348 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-44235628-1234-45f3-b3b1-e72d006fef6a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:33.339777 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-44235628-1234-45f3-b3b1-e72d006fef6a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:33.340538 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-44235628-1234-45f3-b3b1-e72d006fef6a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:33.341624 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-44235628-1234-45f3-b3b1-e72d006fef6a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:33.344506 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=100 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:33.543155 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2b94002d-e9a9-4f1d-82c9-3737efe2e601 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:33.546420 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-44235628-1234-45f3-b3b1-e72d006fef6a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:33.552856 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2b94002d-e9a9-4f1d-82c9-3737efe2e601 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1259 microversion: 2.1 time: 0.232555 Jun 16 18:58:33.553659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-44235628-1234-45f3-b3b1-e72d006fef6a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1369 microversion: 2.1 time: 0.224961 Jun 16 18:58:33.554315 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 187/358] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:33 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1369 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:33.562290 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 172/359] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:33 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1259 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:33.567344 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f65fa2ba-a5f9-4d96-a2be-a9e8d4d8b93e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:33.568032 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f65fa2ba-a5f9-4d96-a2be-a9e8d4d8b93e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:33.574132 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f65fa2ba-a5f9-4d96-a2be-a9e8d4d8b93e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:33.574531 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f65fa2ba-a5f9-4d96-a2be-a9e8d4d8b93e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:33.575834 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f65fa2ba-a5f9-4d96-a2be-a9e8d4d8b93e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:33.576274 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f65fa2ba-a5f9-4d96-a2be-a9e8d4d8b93e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:33.665524 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-16f1a098-2de1-4041-ab18-c47021bed7d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:33.672180 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-16f1a098-2de1-4041-ab18-c47021bed7d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:33.674711 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-16f1a098-2de1-4041-ab18-c47021bed7d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:33.675333 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-16f1a098-2de1-4041-ab18-c47021bed7d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:33.676119 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-16f1a098-2de1-4041-ab18-c47021bed7d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:33.676551 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-16f1a098-2de1-4041-ab18-c47021bed7d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:33.732247 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f65fa2ba-a5f9-4d96-a2be-a9e8d4d8b93e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:33.742781 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f65fa2ba-a5f9-4d96-a2be-a9e8d4d8b93e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.179001 Jun 16 18:58:33.747521 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 188/360] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:33 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:33.817216 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-16f1a098-2de1-4041-ab18-c47021bed7d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:33.826170 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-16f1a098-2de1-4041-ab18-c47021bed7d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:33.827627 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-16f1a098-2de1-4041-ab18-c47021bed7d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:33.828795 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-16f1a098-2de1-4041-ab18-c47021bed7d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.168408 Jun 16 18:58:33.829381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 173/361] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:33 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:34.476354 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-b811aba4-d5a2-4e91-b837-7e945bdc08a0 req-45fc9985-e493-4241-ac3b-f82857525a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88123824-1b55-41ca-a29f-0d3e0edd3d1d", "name": "network-vif-plugged", "status": "completed", "tag": "2fb01582-cf21-44de-8d3e-18570d242041"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:34.485841 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-b811aba4-d5a2-4e91-b837-7e945bdc08a0 req-45fc9985-e493-4241-ac3b-f82857525a52 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:34.486288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-b811aba4-d5a2-4e91-b837-7e945bdc08a0 req-45fc9985-e493-4241-ac3b-f82857525a52 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:34.497025 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-b811aba4-d5a2-4e91-b837-7e945bdc08a0 req-45fc9985-e493-4241-ac3b-f82857525a52 service nova] Creating event network-vif-plugged:2fb01582-cf21-44de-8d3e-18570d242041 for instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d on hv-cinder-84617 Jun 16 18:58:34.501822 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-b811aba4-d5a2-4e91-b837-7e945bdc08a0 req-45fc9985-e493-4241-ac3b-f82857525a52 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029285 Jun 16 18:58:34.502391 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 189/362] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:58:34.568439 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2199228c-6118-4a5b-8bc9-97c7e100fde9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:34.569901 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2199228c-6118-4a5b-8bc9-97c7e100fde9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:34.571293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-098c6f64-170c-4f4f-b50a-ae6c0ece88a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:34.572178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-098c6f64-170c-4f4f-b50a-ae6c0ece88a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:34.577035 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2199228c-6118-4a5b-8bc9-97c7e100fde9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:34.578014 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2199228c-6118-4a5b-8bc9-97c7e100fde9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:34.578435 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-098c6f64-170c-4f4f-b50a-ae6c0ece88a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:34.578607 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2199228c-6118-4a5b-8bc9-97c7e100fde9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:34.578893 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-098c6f64-170c-4f4f-b50a-ae6c0ece88a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:34.579611 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2199228c-6118-4a5b-8bc9-97c7e100fde9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:34.579726 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-098c6f64-170c-4f4f-b50a-ae6c0ece88a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:34.580092 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-098c6f64-170c-4f4f-b50a-ae6c0ece88a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:34.794630 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2199228c-6118-4a5b-8bc9-97c7e100fde9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:34.797711 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-098c6f64-170c-4f4f-b50a-ae6c0ece88a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:34.802217 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2199228c-6118-4a5b-8bc9-97c7e100fde9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1259 microversion: 2.1 time: 0.238041 Jun 16 18:58:34.802753 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 174/363] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:34 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:34.805533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-098c6f64-170c-4f4f-b50a-ae6c0ece88a4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1369 microversion: 2.1 time: 0.239115 Jun 16 18:58:34.806084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 190/364] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:34 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1369 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:34.807116 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-8fb1e3ca-58c4-4a89-8c2e-42ab71b88c46 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:34.807715 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-8fb1e3ca-58c4-4a89-8c2e-42ab71b88c46 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:34.813487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8fb1e3ca-58c4-4a89-8c2e-42ab71b88c46 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:34.813931 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8fb1e3ca-58c4-4a89-8c2e-42ab71b88c46 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:34.814685 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8fb1e3ca-58c4-4a89-8c2e-42ab71b88c46 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:34.815116 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8fb1e3ca-58c4-4a89-8c2e-42ab71b88c46 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:34.847888 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e2b035da-724f-4774-9c1d-5873ddbc6db5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:34.848970 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e2b035da-724f-4774-9c1d-5873ddbc6db5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:34.856213 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e2b035da-724f-4774-9c1d-5873ddbc6db5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:34.857273 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e2b035da-724f-4774-9c1d-5873ddbc6db5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:34.858365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e2b035da-724f-4774-9c1d-5873ddbc6db5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:34.858908 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e2b035da-724f-4774-9c1d-5873ddbc6db5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:35.020112 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8fb1e3ca-58c4-4a89-8c2e-42ab71b88c46 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:35.029508 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-8fb1e3ca-58c4-4a89-8c2e-42ab71b88c46 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.225652 Jun 16 18:58:35.030106 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 175/365] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:34 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:35.058219 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e2b035da-724f-4774-9c1d-5873ddbc6db5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:35.066419 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e2b035da-724f-4774-9c1d-5873ddbc6db5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:35.067937 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e2b035da-724f-4774-9c1d-5873ddbc6db5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:35.069096 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e2b035da-724f-4774-9c1d-5873ddbc6db5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.225294 Jun 16 18:58:35.069685 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 191/366] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:34 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:58:35.818835 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-328ad0cf-9423-4410-b7dd-805ba6e14992 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:35.819448 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-328ad0cf-9423-4410-b7dd-805ba6e14992 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:35.821790 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8c7b3e27-f2e5-4233-b7ff-dd79e83160e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:35.822437 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8c7b3e27-f2e5-4233-b7ff-dd79e83160e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:35.826738 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-328ad0cf-9423-4410-b7dd-805ba6e14992 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:35.828341 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-328ad0cf-9423-4410-b7dd-805ba6e14992 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:35.828341 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-328ad0cf-9423-4410-b7dd-805ba6e14992 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:35.828522 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-328ad0cf-9423-4410-b7dd-805ba6e14992 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:35.829390 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8c7b3e27-f2e5-4233-b7ff-dd79e83160e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:35.829843 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8c7b3e27-f2e5-4233-b7ff-dd79e83160e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:35.830607 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8c7b3e27-f2e5-4233-b7ff-dd79e83160e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:35.831046 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8c7b3e27-f2e5-4233-b7ff-dd79e83160e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:36.030219 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-328ad0cf-9423-4410-b7dd-805ba6e14992 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:36.033627 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8c7b3e27-f2e5-4233-b7ff-dd79e83160e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:36.038563 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-328ad0cf-9423-4410-b7dd-805ba6e14992 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1443 microversion: 2.1 time: 0.223619 Jun 16 18:58:36.039221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 176/367] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:35 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1443 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:36.041409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8c7b3e27-f2e5-4233-b7ff-dd79e83160e0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1369 microversion: 2.1 time: 0.223418 Jun 16 18:58:36.042087 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 192/368] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:35 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1369 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:36.046737 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-03bbbd38-a0b0-45cc-8b2a-1941a9d29b4b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:36.047460 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-03bbbd38-a0b0-45cc-8b2a-1941a9d29b4b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:36.053926 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-03bbbd38-a0b0-45cc-8b2a-1941a9d29b4b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:36.057479 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-03bbbd38-a0b0-45cc-8b2a-1941a9d29b4b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:36.057479 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-03bbbd38-a0b0-45cc-8b2a-1941a9d29b4b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:36.057479 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-03bbbd38-a0b0-45cc-8b2a-1941a9d29b4b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:36.064971 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-bdc5d4fe-2b42-445f-9031-8d67f55abffd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:36.070230 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-bdc5d4fe-2b42-445f-9031-8d67f55abffd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:36.072798 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bdc5d4fe-2b42-445f-9031-8d67f55abffd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:36.073365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bdc5d4fe-2b42-445f-9031-8d67f55abffd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:36.074178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bdc5d4fe-2b42-445f-9031-8d67f55abffd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:36.074630 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bdc5d4fe-2b42-445f-9031-8d67f55abffd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:36.262434 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-03bbbd38-a0b0-45cc-8b2a-1941a9d29b4b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:36.271187 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-03bbbd38-a0b0-45cc-8b2a-1941a9d29b4b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.228157 Jun 16 18:58:36.271752 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 177/369] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:36 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:36.276016 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-bdc5d4fe-2b42-445f-9031-8d67f55abffd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:36.276694 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-770c5639-f2ba-4909-a499-b9cc925128ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:36.277594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-770c5639-f2ba-4909-a499-b9cc925128ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:36.283715 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-770c5639-f2ba-4909-a499-b9cc925128ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:36.284166 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-770c5639-f2ba-4909-a499-b9cc925128ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:36.284938 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-770c5639-f2ba-4909-a499-b9cc925128ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:36.285048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-bdc5d4fe-2b42-445f-9031-8d67f55abffd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1443 microversion: 2.1 time: 0.224056 Jun 16 18:58:36.285426 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-770c5639-f2ba-4909-a499-b9cc925128ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:36.285915 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 193/370] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:36 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1443 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:36.439270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-770c5639-f2ba-4909-a499-b9cc925128ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:36.448257 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-770c5639-f2ba-4909-a499-b9cc925128ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:36.449840 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-770c5639-f2ba-4909-a499-b9cc925128ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:36.451608 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-770c5639-f2ba-4909-a499-b9cc925128ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.178762 Jun 16 18:58:36.452170 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 178/371] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:36 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:37.058578 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9b2203e1-2d15-42fa-b33c-bb9cab54884c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:37.061630 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9b2203e1-2d15-42fa-b33c-bb9cab54884c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:37.066046 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9b2203e1-2d15-42fa-b33c-bb9cab54884c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:37.066727 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9b2203e1-2d15-42fa-b33c-bb9cab54884c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:37.067703 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9b2203e1-2d15-42fa-b33c-bb9cab54884c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:37.068315 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9b2203e1-2d15-42fa-b33c-bb9cab54884c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:37.254642 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9b2203e1-2d15-42fa-b33c-bb9cab54884c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:37.264022 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9b2203e1-2d15-42fa-b33c-bb9cab54884c tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1369 microversion: 2.1 time: 0.209321 Jun 16 18:58:37.264690 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 194/372] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:37 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1369 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:37.288444 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-bc2a618d-3efa-40ca-b2f8-d851e0f40c4c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:37.289057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-bc2a618d-3efa-40ca-b2f8-d851e0f40c4c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:37.302988 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bc2a618d-3efa-40ca-b2f8-d851e0f40c4c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:37.303447 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bc2a618d-3efa-40ca-b2f8-d851e0f40c4c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:37.304226 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bc2a618d-3efa-40ca-b2f8-d851e0f40c4c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:37.304672 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bc2a618d-3efa-40ca-b2f8-d851e0f40c4c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:37.471848 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1c4f5ce3-37bc-453f-902b-5abffe69ce67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:37.474995 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-1c4f5ce3-37bc-453f-902b-5abffe69ce67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:37.483230 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1c4f5ce3-37bc-453f-902b-5abffe69ce67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:37.484189 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1c4f5ce3-37bc-453f-902b-5abffe69ce67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:37.485282 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1c4f5ce3-37bc-453f-902b-5abffe69ce67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:37.485891 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1c4f5ce3-37bc-453f-902b-5abffe69ce67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:37.558324 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-bc2a618d-3efa-40ca-b2f8-d851e0f40c4c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:37.560912 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=100 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:37.568666 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-bc2a618d-3efa-40ca-b2f8-d851e0f40c4c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1721 microversion: 2.1 time: 0.284078 Jun 16 18:58:37.569175 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 179/373] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:37 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:37.757174 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1c4f5ce3-37bc-453f-902b-5abffe69ce67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:37.765108 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1c4f5ce3-37bc-453f-902b-5abffe69ce67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:37.766633 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1c4f5ce3-37bc-453f-902b-5abffe69ce67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:37.767774 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-1c4f5ce3-37bc-453f-902b-5abffe69ce67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.300542 Jun 16 18:58:37.768332 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 195/374] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:37 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:58:38.281024 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-0d03d517-0d1f-4364-a7de-c6a33e866a69 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:38.281988 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-0d03d517-0d1f-4364-a7de-c6a33e866a69 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:38.289996 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0d03d517-0d1f-4364-a7de-c6a33e866a69 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:38.290638 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0d03d517-0d1f-4364-a7de-c6a33e866a69 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:38.291197 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0d03d517-0d1f-4364-a7de-c6a33e866a69 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:38.291629 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0d03d517-0d1f-4364-a7de-c6a33e866a69 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:38.586074 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-df1780cb-a407-40a9-89e9-302aad42bd0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:38.586970 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-df1780cb-a407-40a9-89e9-302aad42bd0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:38.592685 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-df1780cb-a407-40a9-89e9-302aad42bd0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:38.593130 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-df1780cb-a407-40a9-89e9-302aad42bd0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:38.593931 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-df1780cb-a407-40a9-89e9-302aad42bd0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:38.594359 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-df1780cb-a407-40a9-89e9-302aad42bd0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:38.644084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-0d03d517-0d1f-4364-a7de-c6a33e866a69 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:38.652232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-0d03d517-0d1f-4364-a7de-c6a33e866a69 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1562 microversion: 2.1 time: 0.375551 Jun 16 18:58:38.653099 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 180/375] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:38 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1562 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:38.670108 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ec1720ac-cb21-4917-864e-61f7d6f766d5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:38.670605 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ec1720ac-cb21-4917-864e-61f7d6f766d5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:38.677899 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ec1720ac-cb21-4917-864e-61f7d6f766d5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:38.678522 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ec1720ac-cb21-4917-864e-61f7d6f766d5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:38.679492 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ec1720ac-cb21-4917-864e-61f7d6f766d5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:38.680085 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ec1720ac-cb21-4917-864e-61f7d6f766d5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:38.875365 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ec1720ac-cb21-4917-864e-61f7d6f766d5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.210416 Jun 16 18:58:38.876215 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 181/376] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jun 16 18:58:38 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-interface => generated 284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:58:38.881960 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e557cde0-8391-43f3-89d9-e4ee974f49bd tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:38.882788 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e557cde0-8391-43f3-89d9-e4ee974f49bd tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:38.889058 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e557cde0-8391-43f3-89d9-e4ee974f49bd tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:38.889566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e557cde0-8391-43f3-89d9-e4ee974f49bd tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:38.890336 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e557cde0-8391-43f3-89d9-e4ee974f49bd tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:38.890768 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e557cde0-8391-43f3-89d9-e4ee974f49bd tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:38.965215 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-df1780cb-a407-40a9-89e9-302aad42bd0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:38.974359 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-df1780cb-a407-40a9-89e9-302aad42bd0f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1698 microversion: 2.1 time: 0.392099 Jun 16 18:58:38.974924 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 196/377] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:38 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1698 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:39.002380 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4dd5ede7-0f21-4225-ae06-b9584f59f114 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:39.010444 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4dd5ede7-0f21-4225-ae06-b9584f59f114 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:39.011180 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4dd5ede7-0f21-4225-ae06-b9584f59f114 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:39.077524 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4dd5ede7-0f21-4225-ae06-b9584f59f114 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Going to try to start instance {{(pid=130229) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 18:58:39.193857 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e557cde0-8391-43f3-89d9-e4ee974f49bd tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:39.207198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e557cde0-8391-43f3-89d9-e4ee974f49bd tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:39.209293 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e557cde0-8391-43f3-89d9-e4ee974f49bd tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:39.211142 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e557cde0-8391-43f3-89d9-e4ee974f49bd tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.333075 Jun 16 18:58:39.211908 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 182/378] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:38 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:39.236972 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4dd5ede7-0f21-4225-ae06-b9584f59f114 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "POST /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/action" status: 202 len: 0 microversion: 2.1 time: 0.248083 Jun 16 18:58:39.237610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 197/379] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jun 16 18:58:38 2022] POST /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:58:39.248132 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-aeca2778-7777-4090-9ce6-5eea59df8784 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:39.249622 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-aeca2778-7777-4090-9ce6-5eea59df8784 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:39.256766 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aeca2778-7777-4090-9ce6-5eea59df8784 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:39.257380 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aeca2778-7777-4090-9ce6-5eea59df8784 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:39.258564 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aeca2778-7777-4090-9ce6-5eea59df8784 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:39.259235 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aeca2778-7777-4090-9ce6-5eea59df8784 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:39.459786 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-aeca2778-7777-4090-9ce6-5eea59df8784 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:39.479960 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-aeca2778-7777-4090-9ce6-5eea59df8784 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1707 microversion: 2.1 time: 0.236739 Jun 16 18:58:39.490068 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 183/380] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:39 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1707 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:39.569830 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-3ae356c1-bae4-480e-bd18-cb8eaba5ce55 req-c48071af-2005-4659-83fc-8e9005e8a813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf1ba63-bf52-412b-9948-409dadbbdf18", "tag": "9d682d40-5577-43db-823b-b6e4729f33b7"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:39.579530 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-3ae356c1-bae4-480e-bd18-cb8eaba5ce55 req-c48071af-2005-4659-83fc-8e9005e8a813 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:39.579976 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-3ae356c1-bae4-480e-bd18-cb8eaba5ce55 req-c48071af-2005-4659-83fc-8e9005e8a813 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:39.592017 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-3ae356c1-bae4-480e-bd18-cb8eaba5ce55 req-c48071af-2005-4659-83fc-8e9005e8a813 service nova] Creating event network-changed:9d682d40-5577-43db-823b-b6e4729f33b7 for instance 5bf1ba63-bf52-412b-9948-409dadbbdf18 on hv-cinder-84617 Jun 16 18:58:39.597765 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-3ae356c1-bae4-480e-bd18-cb8eaba5ce55 req-c48071af-2005-4659-83fc-8e9005e8a813 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031771 Jun 16 18:58:39.602073 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 198/381] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:40.230169 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ec3d65e5-1482-4f1e-a4b9-331221287b78 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:40.230780 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ec3d65e5-1482-4f1e-a4b9-331221287b78 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:40.241229 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ec3d65e5-1482-4f1e-a4b9-331221287b78 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:40.242162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ec3d65e5-1482-4f1e-a4b9-331221287b78 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:40.248565 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ec3d65e5-1482-4f1e-a4b9-331221287b78 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:40.252237 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ec3d65e5-1482-4f1e-a4b9-331221287b78 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:40.501681 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-adf7df65-af21-4931-bf56-7a9c46ec15f8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:40.503175 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-adf7df65-af21-4931-bf56-7a9c46ec15f8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:40.511904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-adf7df65-af21-4931-bf56-7a9c46ec15f8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:40.512997 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-adf7df65-af21-4931-bf56-7a9c46ec15f8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:40.514422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-adf7df65-af21-4931-bf56-7a9c46ec15f8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:40.515119 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-adf7df65-af21-4931-bf56-7a9c46ec15f8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:40.559200 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ec3d65e5-1482-4f1e-a4b9-331221287b78 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:40.567641 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ec3d65e5-1482-4f1e-a4b9-331221287b78 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:40.569156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ec3d65e5-1482-4f1e-a4b9-331221287b78 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:40.570425 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ec3d65e5-1482-4f1e-a4b9-331221287b78 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.344233 Jun 16 18:58:40.570983 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 184/382] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:40 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:40.826693 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-0315ae8c-1f73-4a78-a10a-8dad1329f9a0 req-a3102c65-ca12-40dc-bcc1-dd80a8df3bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88123824-1b55-41ca-a29f-0d3e0edd3d1d", "tag": "2fb01582-cf21-44de-8d3e-18570d242041"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:40.857940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-0315ae8c-1f73-4a78-a10a-8dad1329f9a0 req-a3102c65-ca12-40dc-bcc1-dd80a8df3bd5 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:40.858586 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-0315ae8c-1f73-4a78-a10a-8dad1329f9a0 req-a3102c65-ca12-40dc-bcc1-dd80a8df3bd5 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:40.888069 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-0315ae8c-1f73-4a78-a10a-8dad1329f9a0 req-a3102c65-ca12-40dc-bcc1-dd80a8df3bd5 service nova] Creating event network-changed:2fb01582-cf21-44de-8d3e-18570d242041 for instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d on hv-cinder-84617 Jun 16 18:58:40.900915 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-0315ae8c-1f73-4a78-a10a-8dad1329f9a0 req-a3102c65-ca12-40dc-bcc1-dd80a8df3bd5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112875 Jun 16 18:58:40.901618 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 185/383] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:41.022568 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-adf7df65-af21-4931-bf56-7a9c46ec15f8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:41.035965 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-adf7df65-af21-4931-bf56-7a9c46ec15f8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1707 microversion: 2.1 time: 0.540225 Jun 16 18:58:41.051370 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 199/384] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:40 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1707 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:41.591166 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-8272caae-19a7-47d1-9436-6227246b9569 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:41.592036 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-8272caae-19a7-47d1-9436-6227246b9569 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:41.599266 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8272caae-19a7-47d1-9436-6227246b9569 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:41.599969 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8272caae-19a7-47d1-9436-6227246b9569 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:41.600899 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8272caae-19a7-47d1-9436-6227246b9569 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:41.601518 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8272caae-19a7-47d1-9436-6227246b9569 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:41.809294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8272caae-19a7-47d1-9436-6227246b9569 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:41.825617 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8272caae-19a7-47d1-9436-6227246b9569 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:41.825617 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8272caae-19a7-47d1-9436-6227246b9569 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:41.825617 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-8272caae-19a7-47d1-9436-6227246b9569 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.238621 Jun 16 18:58:41.826004 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 186/385] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:41 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:58:42.053166 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8c339e06-012a-4eff-9b1f-3aaac389d055 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:42.053874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8c339e06-012a-4eff-9b1f-3aaac389d055 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:42.061275 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8c339e06-012a-4eff-9b1f-3aaac389d055 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:42.062195 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8c339e06-012a-4eff-9b1f-3aaac389d055 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:42.063257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8c339e06-012a-4eff-9b1f-3aaac389d055 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:42.063981 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8c339e06-012a-4eff-9b1f-3aaac389d055 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:42.309792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8c339e06-012a-4eff-9b1f-3aaac389d055 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:42.324554 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8c339e06-012a-4eff-9b1f-3aaac389d055 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1711 microversion: 2.1 time: 0.270672 Jun 16 18:58:42.326971 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 200/386] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:42 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1711 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:42.841672 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e55414ab-e6e5-4905-8c3a-33a6932745fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:42.842474 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e55414ab-e6e5-4905-8c3a-33a6932745fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:42.849497 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e55414ab-e6e5-4905-8c3a-33a6932745fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:42.850105 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e55414ab-e6e5-4905-8c3a-33a6932745fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:42.851412 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e55414ab-e6e5-4905-8c3a-33a6932745fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:42.852490 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e55414ab-e6e5-4905-8c3a-33a6932745fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:43.041765 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e55414ab-e6e5-4905-8c3a-33a6932745fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:43.053320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e55414ab-e6e5-4905-8c3a-33a6932745fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:43.055179 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e55414ab-e6e5-4905-8c3a-33a6932745fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:43.056550 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e55414ab-e6e5-4905-8c3a-33a6932745fc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.218923 Jun 16 18:58:43.057302 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 187/387] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:42 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:44.077491 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c0b27d3e-520f-4247-a3bc-70f3677b9608 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:44.083543 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c0b27d3e-520f-4247-a3bc-70f3677b9608 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:44.090069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c0b27d3e-520f-4247-a3bc-70f3677b9608 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:44.092789 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c0b27d3e-520f-4247-a3bc-70f3677b9608 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:44.092789 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c0b27d3e-520f-4247-a3bc-70f3677b9608 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:44.092789 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c0b27d3e-520f-4247-a3bc-70f3677b9608 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:44.301458 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c0b27d3e-520f-4247-a3bc-70f3677b9608 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:44.310634 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c0b27d3e-520f-4247-a3bc-70f3677b9608 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:44.312143 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c0b27d3e-520f-4247-a3bc-70f3677b9608 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:44.313516 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c0b27d3e-520f-4247-a3bc-70f3677b9608 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.241836 Jun 16 18:58:44.314074 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 201/388] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:44 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:45.332453 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-00e47d59-6aae-4635-91ca-097f414b5588 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:45.333012 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-00e47d59-6aae-4635-91ca-097f414b5588 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:45.340217 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-00e47d59-6aae-4635-91ca-097f414b5588 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:45.345444 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-00e47d59-6aae-4635-91ca-097f414b5588 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:45.345444 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-00e47d59-6aae-4635-91ca-097f414b5588 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:45.345444 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-00e47d59-6aae-4635-91ca-097f414b5588 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:45.511686 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-00e47d59-6aae-4635-91ca-097f414b5588 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:45.520275 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-00e47d59-6aae-4635-91ca-097f414b5588 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:45.521805 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-00e47d59-6aae-4635-91ca-097f414b5588 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:45.522961 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-00e47d59-6aae-4635-91ca-097f414b5588 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.194613 Jun 16 18:58:45.523518 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 188/389] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:45 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:46.544240 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-cc817eaf-116b-4ab5-9b62-2f7398b17e0b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:46.545777 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-cc817eaf-116b-4ab5-9b62-2f7398b17e0b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:46.554912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cc817eaf-116b-4ab5-9b62-2f7398b17e0b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:46.555748 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cc817eaf-116b-4ab5-9b62-2f7398b17e0b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:46.556843 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cc817eaf-116b-4ab5-9b62-2f7398b17e0b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:46.557592 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cc817eaf-116b-4ab5-9b62-2f7398b17e0b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:46.643350 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1864086266", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "networks": [{"uuid": "38d494d8-3507-4c7f-9260-d84973fd6d03"}]}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:46.758741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cc817eaf-116b-4ab5-9b62-2f7398b17e0b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:46.771165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cc817eaf-116b-4ab5-9b62-2f7398b17e0b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:46.772920 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cc817eaf-116b-4ab5-9b62-2f7398b17e0b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:46.791047 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-cc817eaf-116b-4ab5-9b62-2f7398b17e0b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.234106 Jun 16 18:58:46.791047 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 202/390] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:46 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:47.527701 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1226236514", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1310473773", "security_groups": [{"name": "tempest-secgroup-smoke-1909774442"}], "block_device_mapping_v2": [{"uuid": "3b066cf3-25d7-4f57-a47c-c6067b2a8f8f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f31f33e6-f431-4d4c-a847-a5f33b248bb8"}]}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:47.649276 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.network.neutron [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] validate_networks() for [('f31f33e6-f431-4d4c-a847-a5f33b248bb8', None, None, None, None, None)] {{(pid=130229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:58:48.138423 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Flavor limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:58:48.138948 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Image limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:58:48.139558 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Flavor pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:58:48.139966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Image pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:58:48.140390 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:58:48.153668 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:48.154402 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:48.155519 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:48.156224 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:48.183397 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Getting quotas for project fc32e3179c534d83b3d4108a38fb9d19. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:58:48.189211 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Getting quotas for user 1c0e7e9f9d0f409a8820d8bd8dd239cf and project fc32e3179c534d83b3d4108a38fb9d19. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:58:48.198279 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.network.neutron [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] validate_networks() for [('38d494d8-3507-4c7f-9260-d84973fd6d03', None, None, None, None, None)] {{(pid=130230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:58:48.272295 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Going to run 1 instances... {{(pid=130229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:58:48.274931 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3b066cf3-25d7-4f57-a47c-c6067b2a8f8f',volume_size=None,volume_type=None)] {{(pid=130229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:58:48.639599 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Flavor limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:58:48.640126 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Image limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:58:48.650611 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Flavor pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:58:48.650611 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Image pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:58:48.650611 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:58:48.653507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:48.654173 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:48.655328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:48.656339 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:48.677041 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Getting quotas for project c5e5a9406f7f4ccba4aaf2cccf1de07e. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:58:48.679639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Getting quotas for user 325f963f409b4fd68f9ac9a29de4be72 and project c5e5a9406f7f4ccba4aaf2cccf1de07e. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:58:48.691634 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Going to run 1 instances... {{(pid=130230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:58:48.694001 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:58:48.766002 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ccbbf2cb-077d-4acb-bc2c-3f9b62f9d5f8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.243957 Jun 16 18:58:48.786764 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 203/391] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 18:58:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:58:48.786764 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-85b90088-7482-48bf-a7ee-8f5978377bd4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:48.786764 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-85b90088-7482-48bf-a7ee-8f5978377bd4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:48.786764 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-85b90088-7482-48bf-a7ee-8f5978377bd4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:48.787237 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-85b90088-7482-48bf-a7ee-8f5978377bd4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:48.787237 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-85b90088-7482-48bf-a7ee-8f5978377bd4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:48.787237 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-85b90088-7482-48bf-a7ee-8f5978377bd4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:48.940157 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-85b90088-7482-48bf-a7ee-8f5978377bd4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:48.942570 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:48.948970 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-85b90088-7482-48bf-a7ee-8f5978377bd4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:48.950564 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-85b90088-7482-48bf-a7ee-8f5978377bd4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:48.951722 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-85b90088-7482-48bf-a7ee-8f5978377bd4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.184174 Jun 16 18:58:48.952275 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 204/392] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:48 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:48.956633 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ff710d68-d544-4289-971f-a5b3956f9eff tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:48.957258 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ff710d68-d544-4289-971f-a5b3956f9eff tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:49.015828 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ff710d68-d544-4289-971f-a5b3956f9eff tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:49.022504 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ff710d68-d544-4289-971f-a5b3956f9eff tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1095 microversion: 2.1 time: 0.069265 Jun 16 18:58:49.023066 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 205/393] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:48 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:49.211894 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-497cee36-4c58-4fe0-bf8c-749baa94dfb0 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.573961 Jun 16 18:58:49.218753 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 189/394] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 18:58:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 18:58:49.226655 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4a62f3a5-0285-4252-8a68-d9db506c83fe tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:49.227321 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4a62f3a5-0285-4252-8a68-d9db506c83fe tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:49.285045 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4a62f3a5-0285-4252-8a68-d9db506c83fe tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:49.305419 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4a62f3a5-0285-4252-8a68-d9db506c83fe tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1214 microversion: 2.1 time: 0.081951 Jun 16 18:58:49.306297 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 206/395] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:49 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:49.976695 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d8f0d938-b670-43c3-8e18-4e1d53d87177 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:49.977615 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d8f0d938-b670-43c3-8e18-4e1d53d87177 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:49.988105 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d8f0d938-b670-43c3-8e18-4e1d53d87177 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:49.989106 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d8f0d938-b670-43c3-8e18-4e1d53d87177 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:49.990019 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d8f0d938-b670-43c3-8e18-4e1d53d87177 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:49.990702 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d8f0d938-b670-43c3-8e18-4e1d53d87177 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:50.042011 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5a636a1d-7dbd-4c5c-a8a1-1d0997ffb87d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:50.043372 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5a636a1d-7dbd-4c5c-a8a1-1d0997ffb87d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:50.052876 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5a636a1d-7dbd-4c5c-a8a1-1d0997ffb87d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:50.054163 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5a636a1d-7dbd-4c5c-a8a1-1d0997ffb87d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:50.055166 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5a636a1d-7dbd-4c5c-a8a1-1d0997ffb87d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:50.055962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5a636a1d-7dbd-4c5c-a8a1-1d0997ffb87d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:50.178764 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5a636a1d-7dbd-4c5c-a8a1-1d0997ffb87d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:50.190498 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5a636a1d-7dbd-4c5c-a8a1-1d0997ffb87d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1145 microversion: 2.1 time: 0.154446 Jun 16 18:58:50.194277 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 207/396] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:50 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1145 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:50.245288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d8f0d938-b670-43c3-8e18-4e1d53d87177 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:50.256736 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d8f0d938-b670-43c3-8e18-4e1d53d87177 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:50.258637 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d8f0d938-b670-43c3-8e18-4e1d53d87177 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:50.271489 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d8f0d938-b670-43c3-8e18-4e1d53d87177 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.288303 Jun 16 18:58:50.271489 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 190/397] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:49 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:50.323604 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-537e3672-f72e-4b40-91f8-62a6a437973c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:50.324587 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-537e3672-f72e-4b40-91f8-62a6a437973c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:50.422571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-537e3672-f72e-4b40-91f8-62a6a437973c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:50.430488 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-537e3672-f72e-4b40-91f8-62a6a437973c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1214 microversion: 2.1 time: 0.110936 Jun 16 18:58:50.433279 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 208/398] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:50 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:51.211444 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-00329648-b2e4-4bd2-b228-0c8d4eb78b30 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:51.212152 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-00329648-b2e4-4bd2-b228-0c8d4eb78b30 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:51.226829 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-00329648-b2e4-4bd2-b228-0c8d4eb78b30 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:51.227746 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-00329648-b2e4-4bd2-b228-0c8d4eb78b30 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:51.230669 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-00329648-b2e4-4bd2-b228-0c8d4eb78b30 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:51.231346 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-00329648-b2e4-4bd2-b228-0c8d4eb78b30 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:51.281882 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a087fe39-3ed6-4846-91db-e6a54f80ccd6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:51.283168 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a087fe39-3ed6-4846-91db-e6a54f80ccd6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:51.289995 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a087fe39-3ed6-4846-91db-e6a54f80ccd6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:51.291227 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a087fe39-3ed6-4846-91db-e6a54f80ccd6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:51.292192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a087fe39-3ed6-4846-91db-e6a54f80ccd6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:51.292776 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a087fe39-3ed6-4846-91db-e6a54f80ccd6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:51.347139 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-00329648-b2e4-4bd2-b228-0c8d4eb78b30 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:51.363606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-00329648-b2e4-4bd2-b228-0c8d4eb78b30 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1193 microversion: 2.1 time: 0.155013 Jun 16 18:58:51.371064 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 191/399] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:51 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1193 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:51.448262 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-871570d9-e2a6-4cb0-827c-a7bfbe6c7d42 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:51.449171 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-871570d9-e2a6-4cb0-827c-a7bfbe6c7d42 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:51.464072 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-871570d9-e2a6-4cb0-827c-a7bfbe6c7d42 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:51.464802 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-871570d9-e2a6-4cb0-827c-a7bfbe6c7d42 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:51.466026 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-871570d9-e2a6-4cb0-827c-a7bfbe6c7d42 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:51.466647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-871570d9-e2a6-4cb0-827c-a7bfbe6c7d42 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:51.498737 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a087fe39-3ed6-4846-91db-e6a54f80ccd6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:51.507714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a087fe39-3ed6-4846-91db-e6a54f80ccd6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:51.512182 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a087fe39-3ed6-4846-91db-e6a54f80ccd6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:51.513415 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a087fe39-3ed6-4846-91db-e6a54f80ccd6 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.238285 Jun 16 18:58:51.529318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 209/400] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:51 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:51.574165 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-871570d9-e2a6-4cb0-827c-a7bfbe6c7d42 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:51.584237 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-871570d9-e2a6-4cb0-827c-a7bfbe6c7d42 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1266 microversion: 2.1 time: 0.140028 Jun 16 18:58:51.585483 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 192/401] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:51 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:52.381820 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-734b82a9-684f-4d7e-81f7-84916dd24768 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:52.382438 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-734b82a9-684f-4d7e-81f7-84916dd24768 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:52.388951 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-734b82a9-684f-4d7e-81f7-84916dd24768 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:52.389452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-734b82a9-684f-4d7e-81f7-84916dd24768 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:52.390216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-734b82a9-684f-4d7e-81f7-84916dd24768 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:52.390651 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-734b82a9-684f-4d7e-81f7-84916dd24768 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:52.472645 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-734b82a9-684f-4d7e-81f7-84916dd24768 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:52.480980 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-734b82a9-684f-4d7e-81f7-84916dd24768 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1211 microversion: 2.1 time: 0.102975 Jun 16 18:58:52.481675 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 210/402] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:52 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:52.531719 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ab3a0c0e-110c-449d-a7fa-2da0acba0c8a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:52.532278 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ab3a0c0e-110c-449d-a7fa-2da0acba0c8a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:52.539562 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ab3a0c0e-110c-449d-a7fa-2da0acba0c8a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:52.539862 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ab3a0c0e-110c-449d-a7fa-2da0acba0c8a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:52.540634 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ab3a0c0e-110c-449d-a7fa-2da0acba0c8a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:52.541076 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ab3a0c0e-110c-449d-a7fa-2da0acba0c8a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:52.602274 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3a1f702a-c231-4d16-abcd-693cd937de07 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:52.602888 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3a1f702a-c231-4d16-abcd-693cd937de07 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:52.609042 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3a1f702a-c231-4d16-abcd-693cd937de07 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:52.610081 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3a1f702a-c231-4d16-abcd-693cd937de07 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:52.610343 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3a1f702a-c231-4d16-abcd-693cd937de07 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:52.610680 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3a1f702a-c231-4d16-abcd-693cd937de07 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:52.684210 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3a1f702a-c231-4d16-abcd-693cd937de07 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:52.692379 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3a1f702a-c231-4d16-abcd-693cd937de07 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1274 microversion: 2.1 time: 0.093863 Jun 16 18:58:52.693321 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 211/403] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:52 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:52.718781 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ab3a0c0e-110c-449d-a7fa-2da0acba0c8a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:52.726859 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ab3a0c0e-110c-449d-a7fa-2da0acba0c8a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:52.728498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ab3a0c0e-110c-449d-a7fa-2da0acba0c8a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:52.729865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ab3a0c0e-110c-449d-a7fa-2da0acba0c8a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.202268 Jun 16 18:58:52.730506 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 193/404] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:52 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:53.529793 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-083821ca-14f8-4d41-b8ec-0373c4210467 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:53.534839 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-083821ca-14f8-4d41-b8ec-0373c4210467 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:53.558040 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-083821ca-14f8-4d41-b8ec-0373c4210467 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:53.560787 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-083821ca-14f8-4d41-b8ec-0373c4210467 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:53.563240 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-083821ca-14f8-4d41-b8ec-0373c4210467 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:53.564528 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-083821ca-14f8-4d41-b8ec-0373c4210467 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:53.710736 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-8ed911a5-e01c-42d2-8d0c-f73f9631536a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:53.711416 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-8ed911a5-e01c-42d2-8d0c-f73f9631536a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:53.718283 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8ed911a5-e01c-42d2-8d0c-f73f9631536a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:53.718967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8ed911a5-e01c-42d2-8d0c-f73f9631536a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:53.719906 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8ed911a5-e01c-42d2-8d0c-f73f9631536a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:53.720491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8ed911a5-e01c-42d2-8d0c-f73f9631536a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:53.915242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-083821ca-14f8-4d41-b8ec-0373c4210467 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:53.954206 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-083821ca-14f8-4d41-b8ec-0373c4210467 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1279 microversion: 2.1 time: 0.458698 Jun 16 18:58:53.959763 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 212/405] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:53 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1279 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:53.985429 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d2ac09a1-14af-42e5-961f-16ade62a61da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:53.986742 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d2ac09a1-14af-42e5-961f-16ade62a61da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:54.007391 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d2ac09a1-14af-42e5-961f-16ade62a61da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:54.007900 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d2ac09a1-14af-42e5-961f-16ade62a61da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:54.009155 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d2ac09a1-14af-42e5-961f-16ade62a61da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:54.010007 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d2ac09a1-14af-42e5-961f-16ade62a61da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:54.026619 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8ed911a5-e01c-42d2-8d0c-f73f9631536a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:54.038242 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-8ed911a5-e01c-42d2-8d0c-f73f9631536a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.331865 Jun 16 18:58:54.051593 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 194/406] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:53 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:54.333026 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d2ac09a1-14af-42e5-961f-16ade62a61da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:54.344932 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d2ac09a1-14af-42e5-961f-16ade62a61da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:54.357025 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d2ac09a1-14af-42e5-961f-16ade62a61da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:54.358826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d2ac09a1-14af-42e5-961f-16ade62a61da tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.395690 Jun 16 18:58:54.360901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 213/407] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:53 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:54.391763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-344f2d46-3bfc-4c25-9fe3-abd14727f17c req-c97c7503-25fe-49c2-a32a-858e4e02df73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73e2d8a-72b0-45bc-9693-eecf5c504b5b", "tag": "0709fc5a-ab77-4d05-928e-4bfc5179ed37"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:54.454393 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-344f2d46-3bfc-4c25-9fe3-abd14727f17c req-c97c7503-25fe-49c2-a32a-858e4e02df73 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:54.455264 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-344f2d46-3bfc-4c25-9fe3-abd14727f17c req-c97c7503-25fe-49c2-a32a-858e4e02df73 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:54.467818 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-344f2d46-3bfc-4c25-9fe3-abd14727f17c req-c97c7503-25fe-49c2-a32a-858e4e02df73 service nova] Creating event network-changed:0709fc5a-ab77-4d05-928e-4bfc5179ed37 for instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b on hv-cinder-84617 Jun 16 18:58:54.472875 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-344f2d46-3bfc-4c25-9fe3-abd14727f17c req-c97c7503-25fe-49c2-a32a-858e4e02df73 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087441 Jun 16 18:58:54.474000 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 195/408] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:58:54.790491 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-fac2c9f7-da23-4562-8e7d-3a6fc14c5eed req-882a7727-987c-4a6e-8348-4cb20d2a0ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80e17e79-e3fe-4730-b18f-d9aa0a2ba280", "tag": "91d816fa-5153-4ca2-a433-bfd341a293f7"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:54.799366 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-fac2c9f7-da23-4562-8e7d-3a6fc14c5eed req-882a7727-987c-4a6e-8348-4cb20d2a0ed6 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:54.799840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-fac2c9f7-da23-4562-8e7d-3a6fc14c5eed req-882a7727-987c-4a6e-8348-4cb20d2a0ed6 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:54.811044 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-fac2c9f7-da23-4562-8e7d-3a6fc14c5eed req-882a7727-987c-4a6e-8348-4cb20d2a0ed6 service nova] Creating event network-changed:91d816fa-5153-4ca2-a433-bfd341a293f7 for instance 80e17e79-e3fe-4730-b18f-d9aa0a2ba280 on hv-cinder-84617 Jun 16 18:58:54.816081 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-fac2c9f7-da23-4562-8e7d-3a6fc14c5eed req-882a7727-987c-4a6e-8348-4cb20d2a0ed6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029125 Jun 16 18:58:54.816663 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 214/409] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:54.976389 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b3f60aab-f090-424e-9dd8-5fb88a832168 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:54.977105 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b3f60aab-f090-424e-9dd8-5fb88a832168 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:54.988013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b3f60aab-f090-424e-9dd8-5fb88a832168 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:54.988013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b3f60aab-f090-424e-9dd8-5fb88a832168 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:54.988013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b3f60aab-f090-424e-9dd8-5fb88a832168 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:54.988013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b3f60aab-f090-424e-9dd8-5fb88a832168 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:55.057491 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-75f3ada5-75fe-48eb-b4ae-f1b51787bb24 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:55.058374 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-75f3ada5-75fe-48eb-b4ae-f1b51787bb24 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:55.066270 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-75f3ada5-75fe-48eb-b4ae-f1b51787bb24 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:55.066270 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-75f3ada5-75fe-48eb-b4ae-f1b51787bb24 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:55.066602 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-75f3ada5-75fe-48eb-b4ae-f1b51787bb24 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:55.066956 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-75f3ada5-75fe-48eb-b4ae-f1b51787bb24 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:55.248882 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b3f60aab-f090-424e-9dd8-5fb88a832168 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:55.258044 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b3f60aab-f090-424e-9dd8-5fb88a832168 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.285754 Jun 16 18:58:55.265353 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 196/410] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:54 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:55.314979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-75f3ada5-75fe-48eb-b4ae-f1b51787bb24 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:55.322657 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-75f3ada5-75fe-48eb-b4ae-f1b51787bb24 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.270276 Jun 16 18:58:55.323304 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 215/411] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:55 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:55.378692 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-14af86c0-066a-49d7-867c-e848905fb4bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:55.379303 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-14af86c0-066a-49d7-867c-e848905fb4bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:55.381319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:55.386054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-14af86c0-066a-49d7-867c-e848905fb4bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:55.386502 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-14af86c0-066a-49d7-867c-e848905fb4bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:55.387259 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-14af86c0-066a-49d7-867c-e848905fb4bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:55.388254 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-14af86c0-066a-49d7-867c-e848905fb4bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:55.515926 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-14af86c0-066a-49d7-867c-e848905fb4bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:55.523732 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-14af86c0-066a-49d7-867c-e848905fb4bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:55.525231 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-14af86c0-066a-49d7-867c-e848905fb4bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:55.526406 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-14af86c0-066a-49d7-867c-e848905fb4bf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1738 microversion: 2.20 time: 0.151743 Jun 16 18:58:55.526960 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 197/412] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:55 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:56.278976 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5d74a993-bb00-4746-8043-b050eb25794d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:56.279585 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5d74a993-bb00-4746-8043-b050eb25794d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:56.285671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5d74a993-bb00-4746-8043-b050eb25794d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:56.286116 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5d74a993-bb00-4746-8043-b050eb25794d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:56.286874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5d74a993-bb00-4746-8043-b050eb25794d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:56.287302 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5d74a993-bb00-4746-8043-b050eb25794d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:56.338523 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-faffdf3e-0365-4531-bfe7-22d04d41e2be tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:56.339129 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-faffdf3e-0365-4531-bfe7-22d04d41e2be tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:56.345933 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-faffdf3e-0365-4531-bfe7-22d04d41e2be tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:56.346388 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-faffdf3e-0365-4531-bfe7-22d04d41e2be tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:56.347184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-faffdf3e-0365-4531-bfe7-22d04d41e2be tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:56.347631 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-faffdf3e-0365-4531-bfe7-22d04d41e2be tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:56.460638 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5d74a993-bb00-4746-8043-b050eb25794d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:56.471639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5d74a993-bb00-4746-8043-b050eb25794d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.195850 Jun 16 18:58:56.472387 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 216/413] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:56 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:56.534966 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-faffdf3e-0365-4531-bfe7-22d04d41e2be tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:56.543084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=100 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:56.545323 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-054d74b6-a7c6-46d3-abf0-0b257bfd928b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:56.545957 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-faffdf3e-0365-4531-bfe7-22d04d41e2be tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.211255 Jun 16 18:58:56.546125 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-054d74b6-a7c6-46d3-abf0-0b257bfd928b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:56.546942 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 198/414] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:56 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:56.552430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-054d74b6-a7c6-46d3-abf0-0b257bfd928b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:56.557696 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-054d74b6-a7c6-46d3-abf0-0b257bfd928b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:56.557696 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-054d74b6-a7c6-46d3-abf0-0b257bfd928b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:56.557696 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-054d74b6-a7c6-46d3-abf0-0b257bfd928b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:56.964740 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-054d74b6-a7c6-46d3-abf0-0b257bfd928b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:56.973534 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-054d74b6-a7c6-46d3-abf0-0b257bfd928b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:56.975035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-054d74b6-a7c6-46d3-abf0-0b257bfd928b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:56.976252 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-054d74b6-a7c6-46d3-abf0-0b257bfd928b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1720 microversion: 2.20 time: 0.434932 Jun 16 18:58:56.976809 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 217/415] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:56 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1720 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:58:57.488276 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e1f2ddf3-37c4-4c0a-8e6a-72ab017197e3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:57.488891 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e1f2ddf3-37c4-4c0a-8e6a-72ab017197e3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:57.495837 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e1f2ddf3-37c4-4c0a-8e6a-72ab017197e3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:57.496291 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e1f2ddf3-37c4-4c0a-8e6a-72ab017197e3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:57.497090 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e1f2ddf3-37c4-4c0a-8e6a-72ab017197e3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:57.497555 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e1f2ddf3-37c4-4c0a-8e6a-72ab017197e3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:57.563041 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5eec3eeb-b897-4fd0-a589-2edf76166fe2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:57.563675 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5eec3eeb-b897-4fd0-a589-2edf76166fe2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:57.569946 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5eec3eeb-b897-4fd0-a589-2edf76166fe2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:57.570396 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5eec3eeb-b897-4fd0-a589-2edf76166fe2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:57.571168 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5eec3eeb-b897-4fd0-a589-2edf76166fe2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:57.571619 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5eec3eeb-b897-4fd0-a589-2edf76166fe2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:57.656695 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e1f2ddf3-37c4-4c0a-8e6a-72ab017197e3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:57.664127 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e1f2ddf3-37c4-4c0a-8e6a-72ab017197e3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.179780 Jun 16 18:58:57.668071 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 199/416] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:57 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:57.726299 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5eec3eeb-b897-4fd0-a589-2edf76166fe2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:57.734962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5eec3eeb-b897-4fd0-a589-2edf76166fe2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.175818 Jun 16 18:58:57.735530 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 218/417] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:57 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:57.879334 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-23a19ac2-0e76-4d6f-b05e-e9e6fc1b0b7a tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ac4fe09-c07b-4942-a946-a3aa0c0e6c61", "device": "/dev/sdb"}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:57.880965 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-23a19ac2-0e76-4d6f-b05e-e9e6fc1b0b7a tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:57.886953 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-23a19ac2-0e76-4d6f-b05e-e9e6fc1b0b7a tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:57.887398 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-23a19ac2-0e76-4d6f-b05e-e9e6fc1b0b7a tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:57.888775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-23a19ac2-0e76-4d6f-b05e-e9e6fc1b0b7a tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:57.889205 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-23a19ac2-0e76-4d6f-b05e-e9e6fc1b0b7a tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:57.996105 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-cb042da2-e252-42bb-b9a8-d7c9771ed877 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:57.996726 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-cb042da2-e252-42bb-b9a8-d7c9771ed877 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:58.003388 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cb042da2-e252-42bb-b9a8-d7c9771ed877 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:58.003838 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cb042da2-e252-42bb-b9a8-d7c9771ed877 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:58.004605 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cb042da2-e252-42bb-b9a8-d7c9771ed877 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:58.005068 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cb042da2-e252-42bb-b9a8-d7c9771ed877 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:58.134109 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cb042da2-e252-42bb-b9a8-d7c9771ed877 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:58.144552 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cb042da2-e252-42bb-b9a8-d7c9771ed877 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:58.146358 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cb042da2-e252-42bb-b9a8-d7c9771ed877 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:58.147812 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-cb042da2-e252-42bb-b9a8-d7c9771ed877 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1720 microversion: 2.20 time: 0.155614 Jun 16 18:58:58.148502 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 219/418] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:57 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:58:58.562723 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-f4e76e59-ba62-4e08-af48-6dde561f7e8d req-0c4e1b5e-6473-467b-90ed-2138d31bb32f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c04798-b061-421b-9b61-db9cce7dace4", "name": "network-vif-unplugged", "status": "completed", "tag": "44fe652d-5231-4810-99fa-21c58c429e9c"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:58:58.570483 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:58.573085 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-f4e76e59-ba62-4e08-af48-6dde561f7e8d req-0c4e1b5e-6473-467b-90ed-2138d31bb32f service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:58.573756 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-f4e76e59-ba62-4e08-af48-6dde561f7e8d req-0c4e1b5e-6473-467b-90ed-2138d31bb32f service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:58.589975 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-f4e76e59-ba62-4e08-af48-6dde561f7e8d req-0c4e1b5e-6473-467b-90ed-2138d31bb32f service nova] Creating event network-vif-unplugged:44fe652d-5231-4810-99fa-21c58c429e9c for instance d6c04798-b061-421b-9b61-db9cce7dace4 on hv-cinder-84617 Jun 16 18:58:58.596580 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-f4e76e59-ba62-4e08-af48-6dde561f7e8d req-0c4e1b5e-6473-467b-90ed-2138d31bb32f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037976 Jun 16 18:58:58.597817 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 220/419] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:58:58.665222 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:58.685096 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7cc9292d-f683-4515-9e35-7277e2206aca tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:58.686500 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7cc9292d-f683-4515-9e35-7277e2206aca tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:58.687117 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=6 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:58:58.703039 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7cc9292d-f683-4515-9e35-7277e2206aca tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:58.705966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7cc9292d-f683-4515-9e35-7277e2206aca tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:58.708724 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7cc9292d-f683-4515-9e35-7277e2206aca tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:58.709517 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-23a19ac2-0e76-4d6f-b05e-e9e6fc1b0b7a tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "POST /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831918 Jun 16 18:58:58.710066 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7cc9292d-f683-4515-9e35-7277e2206aca tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:58.734382 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 200/420] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jun 16 18:58:57 2022] POST /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e/os-volume_attachments => generated 194 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:58:58.757933 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a38dd34c-6a64-46dd-b84c-14e5ea1cfc76 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:58.758787 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a38dd34c-6a64-46dd-b84c-14e5ea1cfc76 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:58.766934 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a38dd34c-6a64-46dd-b84c-14e5ea1cfc76 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:58.767679 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a38dd34c-6a64-46dd-b84c-14e5ea1cfc76 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:58.769569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a38dd34c-6a64-46dd-b84c-14e5ea1cfc76 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:58.770177 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a38dd34c-6a64-46dd-b84c-14e5ea1cfc76 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:59.008234 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7cc9292d-f683-4515-9e35-7277e2206aca tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:59.017397 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7cc9292d-f683-4515-9e35-7277e2206aca tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.340007 Jun 16 18:58:59.018343 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 221/421] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:58 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:58:59.021488 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a38dd34c-6a64-46dd-b84c-14e5ea1cfc76 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:59.029917 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a38dd34c-6a64-46dd-b84c-14e5ea1cfc76 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.279394 Jun 16 18:58:59.033748 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 201/422] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:58:58 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:58:59.166036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0e4dc0ab-40a2-4972-9b97-3b07ca7c73bc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:58:59.166644 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0e4dc0ab-40a2-4972-9b97-3b07ca7c73bc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:58:59.173084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0e4dc0ab-40a2-4972-9b97-3b07ca7c73bc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:59.173774 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0e4dc0ab-40a2-4972-9b97-3b07ca7c73bc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:59.174694 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0e4dc0ab-40a2-4972-9b97-3b07ca7c73bc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:59.175282 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0e4dc0ab-40a2-4972-9b97-3b07ca7c73bc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:59.304918 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0e4dc0ab-40a2-4972-9b97-3b07ca7c73bc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:59.313321 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0e4dc0ab-40a2-4972-9b97-3b07ca7c73bc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:59.314818 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0e4dc0ab-40a2-4972-9b97-3b07ca7c73bc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:58:59.315966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0e4dc0ab-40a2-4972-9b97-3b07ca7c73bc tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1720 microversion: 2.20 time: 0.153770 Jun 16 18:58:59.316559 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 222/423] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:58:59 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:00.034000 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d85d1780-e382-46b4-b16a-103f103d7425 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:00.034616 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d85d1780-e382-46b4-b16a-103f103d7425 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:00.040996 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d85d1780-e382-46b4-b16a-103f103d7425 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:00.041484 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d85d1780-e382-46b4-b16a-103f103d7425 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:00.042247 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d85d1780-e382-46b4-b16a-103f103d7425 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:00.042683 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d85d1780-e382-46b4-b16a-103f103d7425 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:00.048592 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-05b8548e-e601-4c4a-a0bb-bf8d9dd9ad53 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:00.049146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-05b8548e-e601-4c4a-a0bb-bf8d9dd9ad53 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:00.055075 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-05b8548e-e601-4c4a-a0bb-bf8d9dd9ad53 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:00.055537 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-05b8548e-e601-4c4a-a0bb-bf8d9dd9ad53 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:00.056276 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-05b8548e-e601-4c4a-a0bb-bf8d9dd9ad53 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:00.056706 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-05b8548e-e601-4c4a-a0bb-bf8d9dd9ad53 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:00.230929 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d85d1780-e382-46b4-b16a-103f103d7425 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:00.239438 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d85d1780-e382-46b4-b16a-103f103d7425 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.209280 Jun 16 18:59:00.239998 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 202/424] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:00 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:00.253250 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-05b8548e-e601-4c4a-a0bb-bf8d9dd9ad53 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:00.260787 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-05b8548e-e601-4c4a-a0bb-bf8d9dd9ad53 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.216670 Jun 16 18:59:00.261380 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 223/425] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:00 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:00.334023 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-8f53f445-6955-4df7-8720-dc93d20d5cdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:00.334645 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-8f53f445-6955-4df7-8720-dc93d20d5cdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:00.340718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8f53f445-6955-4df7-8720-dc93d20d5cdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:00.341173 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8f53f445-6955-4df7-8720-dc93d20d5cdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:00.342628 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8f53f445-6955-4df7-8720-dc93d20d5cdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:00.343076 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8f53f445-6955-4df7-8720-dc93d20d5cdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:00.475417 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8f53f445-6955-4df7-8720-dc93d20d5cdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:00.484206 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8f53f445-6955-4df7-8720-dc93d20d5cdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:00.485844 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8f53f445-6955-4df7-8720-dc93d20d5cdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:00.487117 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-8f53f445-6955-4df7-8720-dc93d20d5cdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1720 microversion: 2.20 time: 0.157018 Jun 16 18:59:00.488086 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 203/426] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:00 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:00.613870 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-a95bf4ba-dae7-4bf8-8d15-4e6a6f5ad0cd req-4c158007-4160-4ad9-bf4d-c36b159db66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80e17e79-e3fe-4730-b18f-d9aa0a2ba280", "name": "network-vif-plugged", "status": "completed", "tag": "91d816fa-5153-4ca2-a433-bfd341a293f7"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:00.617445 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=12 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:00.618103 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:00.623303 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-a95bf4ba-dae7-4bf8-8d15-4e6a6f5ad0cd req-4c158007-4160-4ad9-bf4d-c36b159db66e service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:00.623752 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-a95bf4ba-dae7-4bf8-8d15-4e6a6f5ad0cd req-4c158007-4160-4ad9-bf4d-c36b159db66e service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:00.634686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-a95bf4ba-dae7-4bf8-8d15-4e6a6f5ad0cd req-4c158007-4160-4ad9-bf4d-c36b159db66e service nova] Creating event network-vif-plugged:91d816fa-5153-4ca2-a433-bfd341a293f7 for instance 80e17e79-e3fe-4730-b18f-d9aa0a2ba280 on hv-cinder-84617 Jun 16 18:59:00.640016 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-a95bf4ba-dae7-4bf8-8d15-4e6a6f5ad0cd req-4c158007-4160-4ad9-bf4d-c36b159db66e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029951 Jun 16 18:59:00.640770 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 224/427] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:01.256179 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-63c90fed-26d3-4494-9f4a-b2bb4891d53c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:01.256705 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-63c90fed-26d3-4494-9f4a-b2bb4891d53c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:01.263230 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-63c90fed-26d3-4494-9f4a-b2bb4891d53c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:01.263687 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-63c90fed-26d3-4494-9f4a-b2bb4891d53c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:01.264450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-63c90fed-26d3-4494-9f4a-b2bb4891d53c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:01.264896 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-63c90fed-26d3-4494-9f4a-b2bb4891d53c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:01.278417 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-459241f7-6c53-4101-9a9b-c91f731c89c1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:01.279110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-459241f7-6c53-4101-9a9b-c91f731c89c1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:01.286508 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-459241f7-6c53-4101-9a9b-c91f731c89c1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:01.286951 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-459241f7-6c53-4101-9a9b-c91f731c89c1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:01.287733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-459241f7-6c53-4101-9a9b-c91f731c89c1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:01.288184 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-459241f7-6c53-4101-9a9b-c91f731c89c1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:01.471578 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-63c90fed-26d3-4494-9f4a-b2bb4891d53c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:01.474035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-459241f7-6c53-4101-9a9b-c91f731c89c1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:01.480306 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-63c90fed-26d3-4494-9f4a-b2bb4891d53c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.227276 Jun 16 18:59:01.480902 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 204/428] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:01 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:01.483607 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-459241f7-6c53-4101-9a9b-c91f731c89c1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.208657 Jun 16 18:59:01.484182 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 225/429] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:01 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:01.505441 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-28bb6a9b-2a80-488b-8d83-2ea482c1c091 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:01.506044 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-28bb6a9b-2a80-488b-8d83-2ea482c1c091 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:01.512012 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-28bb6a9b-2a80-488b-8d83-2ea482c1c091 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:01.512459 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-28bb6a9b-2a80-488b-8d83-2ea482c1c091 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:01.513211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-28bb6a9b-2a80-488b-8d83-2ea482c1c091 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:01.513696 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-28bb6a9b-2a80-488b-8d83-2ea482c1c091 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:01.642123 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-28bb6a9b-2a80-488b-8d83-2ea482c1c091 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:01.649938 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-28bb6a9b-2a80-488b-8d83-2ea482c1c091 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:01.651435 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-28bb6a9b-2a80-488b-8d83-2ea482c1c091 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:01.653731 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-28bb6a9b-2a80-488b-8d83-2ea482c1c091 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1720 microversion: 2.20 time: 0.151103 Jun 16 18:59:01.653731 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 205/430] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:01 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:02.497439 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3f4cbaa8-2869-4843-be82-f3cd61c85a4a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:02.498764 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3f4cbaa8-2869-4843-be82-f3cd61c85a4a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:02.500039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-393e9d6a-c454-44a1-bbea-ab23a23b0a83 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:02.500651 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-393e9d6a-c454-44a1-bbea-ab23a23b0a83 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:02.504581 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3f4cbaa8-2869-4843-be82-f3cd61c85a4a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:02.505026 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3f4cbaa8-2869-4843-be82-f3cd61c85a4a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:02.505818 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3f4cbaa8-2869-4843-be82-f3cd61c85a4a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:02.506243 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3f4cbaa8-2869-4843-be82-f3cd61c85a4a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:02.507049 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-393e9d6a-c454-44a1-bbea-ab23a23b0a83 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:02.507499 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-393e9d6a-c454-44a1-bbea-ab23a23b0a83 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:02.508257 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-393e9d6a-c454-44a1-bbea-ab23a23b0a83 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:02.509355 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-393e9d6a-c454-44a1-bbea-ab23a23b0a83 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:02.521200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=100 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:02.706415 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3f4cbaa8-2869-4843-be82-f3cd61c85a4a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:02.710788 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-393e9d6a-c454-44a1-bbea-ab23a23b0a83 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:02.714692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3f4cbaa8-2869-4843-be82-f3cd61c85a4a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.221129 Jun 16 18:59:02.715270 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 226/431] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:02 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:02.719432 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-393e9d6a-c454-44a1-bbea-ab23a23b0a83 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.223626 Jun 16 18:59:02.719995 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 206/432] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:02 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:02.721847 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c6237d7a-3b4e-4d56-8044-bdfcf95c6f16 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:02.722582 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c6237d7a-3b4e-4d56-8044-bdfcf95c6f16 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:02.728740 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c6237d7a-3b4e-4d56-8044-bdfcf95c6f16 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:02.729182 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c6237d7a-3b4e-4d56-8044-bdfcf95c6f16 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:02.729993 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c6237d7a-3b4e-4d56-8044-bdfcf95c6f16 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:02.730757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c6237d7a-3b4e-4d56-8044-bdfcf95c6f16 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:02.864312 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c6237d7a-3b4e-4d56-8044-bdfcf95c6f16 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:02.872752 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c6237d7a-3b4e-4d56-8044-bdfcf95c6f16 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:02.875056 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c6237d7a-3b4e-4d56-8044-bdfcf95c6f16 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:02.876217 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c6237d7a-3b4e-4d56-8044-bdfcf95c6f16 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1723 microversion: 2.20 time: 0.160037 Jun 16 18:59:02.876920 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 227/433] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:02 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:02.894107 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-05d0c99d-c0c2-49ca-b794-05286c394fb7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82bf0a56-37d5-419c-86b3-d7135a82338f"}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:02.895244 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-05d0c99d-c0c2-49ca-b794-05286c394fb7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:02.901381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-05d0c99d-c0c2-49ca-b794-05286c394fb7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:02.901842 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-05d0c99d-c0c2-49ca-b794-05286c394fb7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:02.902605 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-05d0c99d-c0c2-49ca-b794-05286c394fb7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:02.903044 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-05d0c99d-c0c2-49ca-b794-05286c394fb7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:03.738659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-83051abb-21d6-433c-88a2-d257a1eefcee tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:03.739205 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-83051abb-21d6-433c-88a2-d257a1eefcee tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:03.745222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-83051abb-21d6-433c-88a2-d257a1eefcee tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:03.745695 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-83051abb-21d6-433c-88a2-d257a1eefcee tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:03.746454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-83051abb-21d6-433c-88a2-d257a1eefcee tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:03.746889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-83051abb-21d6-433c-88a2-d257a1eefcee tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:03.753120 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-05d0c99d-c0c2-49ca-b794-05286c394fb7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "POST /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.862443 Jun 16 18:59:03.753532 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 207/434] 10.222.0.81 () {62 vars in 1363 bytes} [Thu Jun 16 18:59:02 2022] POST /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/os-volume_attachments => generated 188 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:59:03.764525 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d5477141-b5fc-40a2-92b1-afb2e8a7fc5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:03.764525 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d5477141-b5fc-40a2-92b1-afb2e8a7fc5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:03.767859 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d5477141-b5fc-40a2-92b1-afb2e8a7fc5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:03.768328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d5477141-b5fc-40a2-92b1-afb2e8a7fc5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:03.769084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d5477141-b5fc-40a2-92b1-afb2e8a7fc5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:03.769554 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d5477141-b5fc-40a2-92b1-afb2e8a7fc5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:03.948223 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-83051abb-21d6-433c-88a2-d257a1eefcee tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:03.956894 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-83051abb-21d6-433c-88a2-d257a1eefcee tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.222068 Jun 16 18:59:03.957337 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d5477141-b5fc-40a2-92b1-afb2e8a7fc5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:03.966633 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 228/435] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:03 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:03.966633 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6f9660a3-c7e4-4932-9582-7dfda3bcb15b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:03.966633 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6f9660a3-c7e4-4932-9582-7dfda3bcb15b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:03.967157 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d5477141-b5fc-40a2-92b1-afb2e8a7fc5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.210428 Jun 16 18:59:03.967157 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 208/436] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:03 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:03.968910 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6f9660a3-c7e4-4932-9582-7dfda3bcb15b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:03.969403 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6f9660a3-c7e4-4932-9582-7dfda3bcb15b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:03.970177 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6f9660a3-c7e4-4932-9582-7dfda3bcb15b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:03.970615 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6f9660a3-c7e4-4932-9582-7dfda3bcb15b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:04.190390 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6f9660a3-c7e4-4932-9582-7dfda3bcb15b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "POST /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/action" status: 202 len: 0 microversion: 2.20 time: 0.231533 Jun 16 18:59:04.191046 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 229/437] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jun 16 18:59:03 2022] POST /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:59:04.199305 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-67652b07-588d-4dba-8a7c-e82be8a9b150 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:04.199924 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-67652b07-588d-4dba-8a7c-e82be8a9b150 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:04.206011 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67652b07-588d-4dba-8a7c-e82be8a9b150 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:04.206486 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67652b07-588d-4dba-8a7c-e82be8a9b150 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:04.217171 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67652b07-588d-4dba-8a7c-e82be8a9b150 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:04.217171 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67652b07-588d-4dba-8a7c-e82be8a9b150 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:04.342977 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-67652b07-588d-4dba-8a7c-e82be8a9b150 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:04.351980 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-67652b07-588d-4dba-8a7c-e82be8a9b150 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:04.353536 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-67652b07-588d-4dba-8a7c-e82be8a9b150 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:04.354709 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-67652b07-588d-4dba-8a7c-e82be8a9b150 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1809 microversion: 2.20 time: 0.159468 Jun 16 18:59:04.355261 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 209/438] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:04 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:04.974214 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-828f3152-1884-49e6-a142-95defa017cc3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:04.974848 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-828f3152-1884-49e6-a142-95defa017cc3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:04.981119 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-828f3152-1884-49e6-a142-95defa017cc3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:04.981752 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-828f3152-1884-49e6-a142-95defa017cc3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:04.982022 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-7ee250ce-5c39-4f3f-b5ea-879b43a51d2f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:04.982596 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-828f3152-1884-49e6-a142-95defa017cc3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:04.983040 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-828f3152-1884-49e6-a142-95defa017cc3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:04.983168 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-7ee250ce-5c39-4f3f-b5ea-879b43a51d2f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:04.989559 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7ee250ce-5c39-4f3f-b5ea-879b43a51d2f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:04.990004 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7ee250ce-5c39-4f3f-b5ea-879b43a51d2f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:04.990761 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7ee250ce-5c39-4f3f-b5ea-879b43a51d2f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:04.991606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7ee250ce-5c39-4f3f-b5ea-879b43a51d2f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:05.309016 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-828f3152-1884-49e6-a142-95defa017cc3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:05.318125 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-7ee250ce-5c39-4f3f-b5ea-879b43a51d2f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:05.318327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-828f3152-1884-49e6-a142-95defa017cc3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.347867 Jun 16 18:59:05.318898 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 230/439] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:04 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:05.327041 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-7ee250ce-5c39-4f3f-b5ea-879b43a51d2f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.349080 Jun 16 18:59:05.328940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 210/440] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:04 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:05.374385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f6b7e7b2-5d9c-4acf-aa86-283c5c46709f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:05.374992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f6b7e7b2-5d9c-4acf-aa86-283c5c46709f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:05.380888 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f6b7e7b2-5d9c-4acf-aa86-283c5c46709f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:05.381363 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f6b7e7b2-5d9c-4acf-aa86-283c5c46709f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:05.382119 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f6b7e7b2-5d9c-4acf-aa86-283c5c46709f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:05.382555 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f6b7e7b2-5d9c-4acf-aa86-283c5c46709f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:05.526300 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f6b7e7b2-5d9c-4acf-aa86-283c5c46709f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:05.534669 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f6b7e7b2-5d9c-4acf-aa86-283c5c46709f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:05.536166 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f6b7e7b2-5d9c-4acf-aa86-283c5c46709f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:05.537345 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f6b7e7b2-5d9c-4acf-aa86-283c5c46709f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1809 microversion: 2.20 time: 0.167396 Jun 16 18:59:05.537904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 231/441] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:05 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:06.336112 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1ff7ec22-c6c7-49a7-8d4a-3cc74ce153a6 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:06.336721 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1ff7ec22-c6c7-49a7-8d4a-3cc74ce153a6 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:06.343957 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1ff7ec22-c6c7-49a7-8d4a-3cc74ce153a6 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:06.344299 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-85cbfbb7-2d7f-4b60-8a9c-516a0fe7ab44 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:06.344721 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1ff7ec22-c6c7-49a7-8d4a-3cc74ce153a6 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:06.344918 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-85cbfbb7-2d7f-4b60-8a9c-516a0fe7ab44 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:06.345150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1ff7ec22-c6c7-49a7-8d4a-3cc74ce153a6 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:06.345660 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1ff7ec22-c6c7-49a7-8d4a-3cc74ce153a6 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:06.353495 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-85cbfbb7-2d7f-4b60-8a9c-516a0fe7ab44 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:06.353940 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-85cbfbb7-2d7f-4b60-8a9c-516a0fe7ab44 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:06.354709 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-85cbfbb7-2d7f-4b60-8a9c-516a0fe7ab44 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:06.355146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-85cbfbb7-2d7f-4b60-8a9c-516a0fe7ab44 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:06.361447 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:06.542858 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1ff7ec22-c6c7-49a7-8d4a-3cc74ce153a6 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:06.547299 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-85cbfbb7-2d7f-4b60-8a9c-516a0fe7ab44 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:06.555223 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1ff7ec22-c6c7-49a7-8d4a-3cc74ce153a6 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.223093 Jun 16 18:59:06.555812 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 211/442] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:06 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:06.565729 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-85cbfbb7-2d7f-4b60-8a9c-516a0fe7ab44 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.217337 Jun 16 18:59:06.565729 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 232/443] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:06 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:06.565948 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c23f95f1-30c6-4c1b-9c7e-b99619c7e6cf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:06.565948 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-c23f95f1-30c6-4c1b-9c7e-b99619c7e6cf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:06.567845 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c23f95f1-30c6-4c1b-9c7e-b99619c7e6cf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:06.568299 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c23f95f1-30c6-4c1b-9c7e-b99619c7e6cf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:06.569074 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c23f95f1-30c6-4c1b-9c7e-b99619c7e6cf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:06.569616 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c23f95f1-30c6-4c1b-9c7e-b99619c7e6cf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:06.706175 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c23f95f1-30c6-4c1b-9c7e-b99619c7e6cf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:06.714457 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c23f95f1-30c6-4c1b-9c7e-b99619c7e6cf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:06.715949 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c23f95f1-30c6-4c1b-9c7e-b99619c7e6cf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:06.717255 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-c23f95f1-30c6-4c1b-9c7e-b99619c7e6cf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1809 microversion: 2.20 time: 0.160250 Jun 16 18:59:06.717815 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 212/444] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:06 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:07.574072 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-82cb684b-9578-436c-8e64-39450514b90c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:07.574635 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-17e96494-1fd8-4041-ac6b-3177fc35dda8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:07.575005 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-82cb684b-9578-436c-8e64-39450514b90c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:07.575100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-17e96494-1fd8-4041-ac6b-3177fc35dda8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:07.581170 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-82cb684b-9578-436c-8e64-39450514b90c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:07.581878 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-17e96494-1fd8-4041-ac6b-3177fc35dda8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:07.581878 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-17e96494-1fd8-4041-ac6b-3177fc35dda8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:07.582654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-17e96494-1fd8-4041-ac6b-3177fc35dda8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:07.582756 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-82cb684b-9578-436c-8e64-39450514b90c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:07.583093 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-17e96494-1fd8-4041-ac6b-3177fc35dda8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:07.583452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-82cb684b-9578-436c-8e64-39450514b90c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:07.583895 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-82cb684b-9578-436c-8e64-39450514b90c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:07.772200 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-17e96494-1fd8-4041-ac6b-3177fc35dda8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:07.780158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-82cb684b-9578-436c-8e64-39450514b90c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:07.780342 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-17e96494-1fd8-4041-ac6b-3177fc35dda8 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.210084 Jun 16 18:59:07.780720 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 213/445] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:07 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:07.785934 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-45cc46c2-f3dc-4bc9-95d0-c6fe39cf6dc2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:07.786709 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-45cc46c2-f3dc-4bc9-95d0-c6fe39cf6dc2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:07.788940 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-82cb684b-9578-436c-8e64-39450514b90c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.218659 Jun 16 18:59:07.792789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-45cc46c2-f3dc-4bc9-95d0-c6fe39cf6dc2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:07.793270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-45cc46c2-f3dc-4bc9-95d0-c6fe39cf6dc2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:07.794034 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-45cc46c2-f3dc-4bc9-95d0-c6fe39cf6dc2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:07.794471 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-45cc46c2-f3dc-4bc9-95d0-c6fe39cf6dc2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:07.799583 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 233/446] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:07 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:07.932812 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-45cc46c2-f3dc-4bc9-95d0-c6fe39cf6dc2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:07.941394 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-45cc46c2-f3dc-4bc9-95d0-c6fe39cf6dc2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:07.942901 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-45cc46c2-f3dc-4bc9-95d0-c6fe39cf6dc2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:07.944058 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-45cc46c2-f3dc-4bc9-95d0-c6fe39cf6dc2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1809 microversion: 2.20 time: 0.161711 Jun 16 18:59:07.944611 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 214/447] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:07 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:08.796961 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e40d34f0-3724-4528-88b5-ff3ada8c43e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:08.797525 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e40d34f0-3724-4528-88b5-ff3ada8c43e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:08.804305 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e40d34f0-3724-4528-88b5-ff3ada8c43e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:08.804756 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e40d34f0-3724-4528-88b5-ff3ada8c43e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:08.805552 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e40d34f0-3724-4528-88b5-ff3ada8c43e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:08.805989 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e40d34f0-3724-4528-88b5-ff3ada8c43e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:08.806194 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-7068fd03-15e4-4324-9559-3e778cb2acbb tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:08.806814 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-7068fd03-15e4-4324-9559-3e778cb2acbb tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:08.813944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7068fd03-15e4-4324-9559-3e778cb2acbb tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:08.814508 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7068fd03-15e4-4324-9559-3e778cb2acbb tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:08.815270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7068fd03-15e4-4324-9559-3e778cb2acbb tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:08.815712 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7068fd03-15e4-4324-9559-3e778cb2acbb tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:08.995485 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e40d34f0-3724-4528-88b5-ff3ada8c43e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:09.003555 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e40d34f0-3724-4528-88b5-ff3ada8c43e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.210466 Jun 16 18:59:09.004135 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 234/448] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:08 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:09.008703 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3c610b0c-f0f6-49b8-9cdf-5bbd7a9f5287 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:09.012023 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3c610b0c-f0f6-49b8-9cdf-5bbd7a9f5287 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:09.012137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-7068fd03-15e4-4324-9559-3e778cb2acbb tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:09.015422 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3c610b0c-f0f6-49b8-9cdf-5bbd7a9f5287 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:09.015897 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3c610b0c-f0f6-49b8-9cdf-5bbd7a9f5287 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:09.016676 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3c610b0c-f0f6-49b8-9cdf-5bbd7a9f5287 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:09.017114 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3c610b0c-f0f6-49b8-9cdf-5bbd7a9f5287 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:09.017610 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-7068fd03-15e4-4324-9559-3e778cb2acbb tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.215082 Jun 16 18:59:09.018391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 215/449] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:08 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:09.146252 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3c610b0c-f0f6-49b8-9cdf-5bbd7a9f5287 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:09.154725 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3c610b0c-f0f6-49b8-9cdf-5bbd7a9f5287 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:09.156236 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3c610b0c-f0f6-49b8-9cdf-5bbd7a9f5287 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:09.157968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3c610b0c-f0f6-49b8-9cdf-5bbd7a9f5287 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1809 microversion: 2.20 time: 0.152899 Jun 16 18:59:09.158532 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 235/450] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:09 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:10.020459 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a860c8ac-c7b8-484d-bc5e-7c67fc4399fc tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:10.020963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a860c8ac-c7b8-484d-bc5e-7c67fc4399fc tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:10.027459 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a860c8ac-c7b8-484d-bc5e-7c67fc4399fc tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:10.027906 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a860c8ac-c7b8-484d-bc5e-7c67fc4399fc tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:10.028655 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a860c8ac-c7b8-484d-bc5e-7c67fc4399fc tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:10.029092 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a860c8ac-c7b8-484d-bc5e-7c67fc4399fc tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:10.035533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9dc792a7-b495-45b8-a421-a0596835375c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:10.036145 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9dc792a7-b495-45b8-a421-a0596835375c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:10.042363 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9dc792a7-b495-45b8-a421-a0596835375c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:10.042809 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9dc792a7-b495-45b8-a421-a0596835375c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:10.043574 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9dc792a7-b495-45b8-a421-a0596835375c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:10.044020 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9dc792a7-b495-45b8-a421-a0596835375c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:10.431353 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a860c8ac-c7b8-484d-bc5e-7c67fc4399fc tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:10.439950 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a860c8ac-c7b8-484d-bc5e-7c67fc4399fc tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.423757 Jun 16 18:59:10.440710 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 216/451] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:10 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:10.442524 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9dc792a7-b495-45b8-a421-a0596835375c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:10.445539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5993a4d0-d48a-498e-9b2f-1ce733d94b2a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:10.446432 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5993a4d0-d48a-498e-9b2f-1ce733d94b2a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:10.450649 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9dc792a7-b495-45b8-a421-a0596835375c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.419759 Jun 16 18:59:10.456059 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 236/452] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:10 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:10.456176 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5993a4d0-d48a-498e-9b2f-1ce733d94b2a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:10.456176 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5993a4d0-d48a-498e-9b2f-1ce733d94b2a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:10.456176 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5993a4d0-d48a-498e-9b2f-1ce733d94b2a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:10.456176 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5993a4d0-d48a-498e-9b2f-1ce733d94b2a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:10.587136 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5993a4d0-d48a-498e-9b2f-1ce733d94b2a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:10.595388 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5993a4d0-d48a-498e-9b2f-1ce733d94b2a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:10.596916 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5993a4d0-d48a-498e-9b2f-1ce733d94b2a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:10.598108 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5993a4d0-d48a-498e-9b2f-1ce733d94b2a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1809 microversion: 2.20 time: 0.156298 Jun 16 18:59:10.598652 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 217/453] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:10 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:11.455918 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e31cabda-3be2-4940-8e80-ee1c25869cec tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:11.456968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e31cabda-3be2-4940-8e80-ee1c25869cec tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:11.464103 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e31cabda-3be2-4940-8e80-ee1c25869cec tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:11.464548 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e31cabda-3be2-4940-8e80-ee1c25869cec tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:11.466976 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e31cabda-3be2-4940-8e80-ee1c25869cec tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:11.466976 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e31cabda-3be2-4940-8e80-ee1c25869cec tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:11.478281 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ee7055a5-4279-475d-98f6-c23b2c5af569 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:11.479782 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ee7055a5-4279-475d-98f6-c23b2c5af569 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:11.491056 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ee7055a5-4279-475d-98f6-c23b2c5af569 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:11.499597 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ee7055a5-4279-475d-98f6-c23b2c5af569 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:11.499597 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ee7055a5-4279-475d-98f6-c23b2c5af569 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:11.499597 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ee7055a5-4279-475d-98f6-c23b2c5af569 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:11.670826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e31cabda-3be2-4940-8e80-ee1c25869cec tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:11.678493 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e31cabda-3be2-4940-8e80-ee1c25869cec tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.226475 Jun 16 18:59:11.678636 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ee7055a5-4279-475d-98f6-c23b2c5af569 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:11.679069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 237/454] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:11 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:11.686361 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ee7055a5-4279-475d-98f6-c23b2c5af569 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.218064 Jun 16 18:59:11.692830 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 218/455] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:11 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:11.692964 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8e833670-a40a-49a7-9332-4af8c0108982 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:11.692964 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8e833670-a40a-49a7-9332-4af8c0108982 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:11.698770 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8e833670-a40a-49a7-9332-4af8c0108982 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:11.699321 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8e833670-a40a-49a7-9332-4af8c0108982 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:11.700088 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8e833670-a40a-49a7-9332-4af8c0108982 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:11.700524 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8e833670-a40a-49a7-9332-4af8c0108982 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:11.826794 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8e833670-a40a-49a7-9332-4af8c0108982 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:11.835587 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8e833670-a40a-49a7-9332-4af8c0108982 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:11.837079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8e833670-a40a-49a7-9332-4af8c0108982 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:11.838268 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8e833670-a40a-49a7-9332-4af8c0108982 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1809 microversion: 2.20 time: 0.149884 Jun 16 18:59:11.838830 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 238/456] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:11 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:12.694695 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5de3a518-23ff-442e-8a08-08dd06b6579c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:12.695256 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5de3a518-23ff-442e-8a08-08dd06b6579c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:12.701767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5de3a518-23ff-442e-8a08-08dd06b6579c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:12.702215 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5de3a518-23ff-442e-8a08-08dd06b6579c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:12.702984 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5de3a518-23ff-442e-8a08-08dd06b6579c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:12.703444 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5de3a518-23ff-442e-8a08-08dd06b6579c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:12.707077 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3122881a-7ce3-436f-854e-aa5293823cc5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:12.707689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3122881a-7ce3-436f-854e-aa5293823cc5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:12.713679 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3122881a-7ce3-436f-854e-aa5293823cc5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:12.714103 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3122881a-7ce3-436f-854e-aa5293823cc5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:12.714859 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3122881a-7ce3-436f-854e-aa5293823cc5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:12.715286 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3122881a-7ce3-436f-854e-aa5293823cc5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:12.910136 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5de3a518-23ff-442e-8a08-08dd06b6579c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:12.914282 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3122881a-7ce3-436f-854e-aa5293823cc5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:12.917931 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5de3a518-23ff-442e-8a08-08dd06b6579c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.227230 Jun 16 18:59:12.918562 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 219/457] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:12 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:12.921621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3122881a-7ce3-436f-854e-aa5293823cc5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.218756 Jun 16 18:59:12.922364 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 239/458] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:12 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:12.923866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d9a0028b-dd70-4380-b0a9-42ed2d6dbaa0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:12.924545 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d9a0028b-dd70-4380-b0a9-42ed2d6dbaa0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:12.930448 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d9a0028b-dd70-4380-b0a9-42ed2d6dbaa0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:12.930886 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d9a0028b-dd70-4380-b0a9-42ed2d6dbaa0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:12.931656 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d9a0028b-dd70-4380-b0a9-42ed2d6dbaa0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:12.932099 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d9a0028b-dd70-4380-b0a9-42ed2d6dbaa0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:13.067997 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d9a0028b-dd70-4380-b0a9-42ed2d6dbaa0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:13.076590 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d9a0028b-dd70-4380-b0a9-42ed2d6dbaa0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:13.078229 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d9a0028b-dd70-4380-b0a9-42ed2d6dbaa0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:13.080014 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d9a0028b-dd70-4380-b0a9-42ed2d6dbaa0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1809 microversion: 2.20 time: 0.160335 Jun 16 18:59:13.080475 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 220/459] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:12 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:13.935072 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f398325a-f424-42ec-bf9a-6c9dbf75893e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:13.935688 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f398325a-f424-42ec-bf9a-6c9dbf75893e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:13.939608 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f193d834-a99d-4f03-823d-45cee6964a01 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:13.940222 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f193d834-a99d-4f03-823d-45cee6964a01 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:13.942359 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f398325a-f424-42ec-bf9a-6c9dbf75893e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:13.942806 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f398325a-f424-42ec-bf9a-6c9dbf75893e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:13.943574 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f398325a-f424-42ec-bf9a-6c9dbf75893e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:13.944011 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f398325a-f424-42ec-bf9a-6c9dbf75893e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:13.946582 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f193d834-a99d-4f03-823d-45cee6964a01 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:13.947030 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f193d834-a99d-4f03-823d-45cee6964a01 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:13.947800 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f193d834-a99d-4f03-823d-45cee6964a01 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:13.948233 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f193d834-a99d-4f03-823d-45cee6964a01 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:14.139820 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f398325a-f424-42ec-bf9a-6c9dbf75893e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:14.142910 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f193d834-a99d-4f03-823d-45cee6964a01 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:14.147635 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f398325a-f424-42ec-bf9a-6c9dbf75893e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.216382 Jun 16 18:59:14.148209 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 240/460] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:13 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:14.150603 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f193d834-a99d-4f03-823d-45cee6964a01 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.215264 Jun 16 18:59:14.151251 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 221/461] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:13 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:14.155667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d35f97c9-5449-4234-840e-8917130a2ae4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:14.156350 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d35f97c9-5449-4234-840e-8917130a2ae4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:14.162886 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d35f97c9-5449-4234-840e-8917130a2ae4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:14.163330 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d35f97c9-5449-4234-840e-8917130a2ae4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:14.164144 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d35f97c9-5449-4234-840e-8917130a2ae4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:14.164581 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d35f97c9-5449-4234-840e-8917130a2ae4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:14.292252 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d35f97c9-5449-4234-840e-8917130a2ae4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:14.301202 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d35f97c9-5449-4234-840e-8917130a2ae4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:14.302743 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d35f97c9-5449-4234-840e-8917130a2ae4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:14.303898 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d35f97c9-5449-4234-840e-8917130a2ae4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1809 microversion: 2.20 time: 0.154784 Jun 16 18:59:14.304463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 241/462] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:14 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:15.164189 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-35ad55f8-3d15-414e-8b34-ad3d1bbd102e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:15.164886 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-35ad55f8-3d15-414e-8b34-ad3d1bbd102e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:15.167544 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-bf28131b-36f0-493a-81da-61545c3dccd8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:15.168162 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-bf28131b-36f0-493a-81da-61545c3dccd8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:15.171437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-35ad55f8-3d15-414e-8b34-ad3d1bbd102e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:15.171888 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-35ad55f8-3d15-414e-8b34-ad3d1bbd102e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:15.172725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-35ad55f8-3d15-414e-8b34-ad3d1bbd102e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:15.173165 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-35ad55f8-3d15-414e-8b34-ad3d1bbd102e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:15.174209 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bf28131b-36f0-493a-81da-61545c3dccd8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:15.174657 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bf28131b-36f0-493a-81da-61545c3dccd8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:15.175430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bf28131b-36f0-493a-81da-61545c3dccd8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:15.175867 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bf28131b-36f0-493a-81da-61545c3dccd8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:15.179890 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:15.371966 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-35ad55f8-3d15-414e-8b34-ad3d1bbd102e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:15.375018 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-bf28131b-36f0-493a-81da-61545c3dccd8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:15.380624 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-35ad55f8-3d15-414e-8b34-ad3d1bbd102e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.220144 Jun 16 18:59:15.381201 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 222/463] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:15 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:15.385751 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2840d069-7e12-4c23-b6d1-521da58bc8b5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:15.386344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2840d069-7e12-4c23-b6d1-521da58bc8b5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:15.388489 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-bf28131b-36f0-493a-81da-61545c3dccd8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.224730 Jun 16 18:59:15.389058 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 242/464] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:15 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:15.392203 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2840d069-7e12-4c23-b6d1-521da58bc8b5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:15.392640 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2840d069-7e12-4c23-b6d1-521da58bc8b5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:15.393422 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2840d069-7e12-4c23-b6d1-521da58bc8b5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:15.393875 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2840d069-7e12-4c23-b6d1-521da58bc8b5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:15.525265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2840d069-7e12-4c23-b6d1-521da58bc8b5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:15.533758 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2840d069-7e12-4c23-b6d1-521da58bc8b5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:15.535257 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2840d069-7e12-4c23-b6d1-521da58bc8b5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:15.536416 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2840d069-7e12-4c23-b6d1-521da58bc8b5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1809 microversion: 2.20 time: 0.154282 Jun 16 18:59:15.536966 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 223/465] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:15 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:16.397625 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-87548098-048e-455a-b39f-36287fd65642 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:16.398234 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-87548098-048e-455a-b39f-36287fd65642 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:16.404484 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-87548098-048e-455a-b39f-36287fd65642 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:16.404840 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-faf7c748-cd1e-4016-8e29-a6e9ab4ec992 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:16.405276 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-87548098-048e-455a-b39f-36287fd65642 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:16.405538 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-faf7c748-cd1e-4016-8e29-a6e9ab4ec992 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:16.405720 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-87548098-048e-455a-b39f-36287fd65642 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:16.406160 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-87548098-048e-455a-b39f-36287fd65642 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:16.411891 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-faf7c748-cd1e-4016-8e29-a6e9ab4ec992 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:16.412342 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-faf7c748-cd1e-4016-8e29-a6e9ab4ec992 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:16.413105 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-faf7c748-cd1e-4016-8e29-a6e9ab4ec992 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:16.413572 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-faf7c748-cd1e-4016-8e29-a6e9ab4ec992 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:16.595440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-87548098-048e-455a-b39f-36287fd65642 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:16.602088 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-faf7c748-cd1e-4016-8e29-a6e9ab4ec992 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:16.602831 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-87548098-048e-455a-b39f-36287fd65642 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.208986 Jun 16 18:59:16.603403 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 243/466] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:16 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:16.607985 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9352cd77-bc11-46b3-8693-978694b42f21 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:16.608583 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9352cd77-bc11-46b3-8693-978694b42f21 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:16.609953 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-faf7c748-cd1e-4016-8e29-a6e9ab4ec992 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.208792 Jun 16 18:59:16.610657 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 224/467] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:16 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:16.614490 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9352cd77-bc11-46b3-8693-978694b42f21 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:16.614938 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9352cd77-bc11-46b3-8693-978694b42f21 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:16.615698 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9352cd77-bc11-46b3-8693-978694b42f21 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:16.616136 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9352cd77-bc11-46b3-8693-978694b42f21 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:16.744734 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9352cd77-bc11-46b3-8693-978694b42f21 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:16.753703 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9352cd77-bc11-46b3-8693-978694b42f21 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:16.755196 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9352cd77-bc11-46b3-8693-978694b42f21 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:16.756342 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9352cd77-bc11-46b3-8693-978694b42f21 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1809 microversion: 2.20 time: 0.152035 Jun 16 18:59:16.756895 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 244/468] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:16 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:17.621345 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-df85398d-885b-4651-96b4-ea3b1ddb0336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:17.621345 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-df85398d-885b-4651-96b4-ea3b1ddb0336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:17.628061 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9b2c138e-e838-4c70-b44d-36fe717b0e48 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:17.628689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9b2c138e-e838-4c70-b44d-36fe717b0e48 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:17.628991 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-df85398d-885b-4651-96b4-ea3b1ddb0336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:17.629664 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-df85398d-885b-4651-96b4-ea3b1ddb0336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:17.630845 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-df85398d-885b-4651-96b4-ea3b1ddb0336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:17.631013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-df85398d-885b-4651-96b4-ea3b1ddb0336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:17.635743 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9b2c138e-e838-4c70-b44d-36fe717b0e48 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:17.640139 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9b2c138e-e838-4c70-b44d-36fe717b0e48 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:17.640139 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9b2c138e-e838-4c70-b44d-36fe717b0e48 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:17.640139 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9b2c138e-e838-4c70-b44d-36fe717b0e48 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:17.835592 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-df85398d-885b-4651-96b4-ea3b1ddb0336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:17.836350 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9b2c138e-e838-4c70-b44d-36fe717b0e48 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:17.841013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-df85398d-885b-4651-96b4-ea3b1ddb0336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.225165 Jun 16 18:59:17.841626 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 225/469] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:17 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:17.843843 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9b2c138e-e838-4c70-b44d-36fe717b0e48 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.220753 Jun 16 18:59:17.844598 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 245/470] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:17 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:17.846799 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-7cb9f8d3-d4ab-4bb0-bce3-ab5e8f11772c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:17.847421 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-7cb9f8d3-d4ab-4bb0-bce3-ab5e8f11772c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:17.853135 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7cb9f8d3-d4ab-4bb0-bce3-ab5e8f11772c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:17.859425 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7cb9f8d3-d4ab-4bb0-bce3-ab5e8f11772c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:17.859425 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7cb9f8d3-d4ab-4bb0-bce3-ab5e8f11772c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:17.859425 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7cb9f8d3-d4ab-4bb0-bce3-ab5e8f11772c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:17.983911 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-7cb9f8d3-d4ab-4bb0-bce3-ab5e8f11772c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:17.992552 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-7cb9f8d3-d4ab-4bb0-bce3-ab5e8f11772c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:17.994160 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-7cb9f8d3-d4ab-4bb0-bce3-ab5e8f11772c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:17.995305 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-7cb9f8d3-d4ab-4bb0-bce3-ab5e8f11772c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1809 microversion: 2.20 time: 0.152785 Jun 16 18:59:17.995850 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 226/471] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:17 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:18.862504 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b2ee0b60-c428-4604-951c-9f5b41d5054d tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:18.863251 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b2ee0b60-c428-4604-951c-9f5b41d5054d tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:18.863617 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-df4f48de-3b70-4c98-8c6d-575946fb05b5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:18.864792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-df4f48de-3b70-4c98-8c6d-575946fb05b5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:18.869971 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b2ee0b60-c428-4604-951c-9f5b41d5054d tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:18.870422 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b2ee0b60-c428-4604-951c-9f5b41d5054d tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:18.871220 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b2ee0b60-c428-4604-951c-9f5b41d5054d tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:18.871326 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-df4f48de-3b70-4c98-8c6d-575946fb05b5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:18.871655 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b2ee0b60-c428-4604-951c-9f5b41d5054d tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:18.871774 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-df4f48de-3b70-4c98-8c6d-575946fb05b5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:18.872457 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-df4f48de-3b70-4c98-8c6d-575946fb05b5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:18.872895 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-df4f48de-3b70-4c98-8c6d-575946fb05b5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:19.066849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b2ee0b60-c428-4604-951c-9f5b41d5054d tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:19.075754 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-df4f48de-3b70-4c98-8c6d-575946fb05b5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:19.080371 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b2ee0b60-c428-4604-951c-9f5b41d5054d tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.221892 Jun 16 18:59:19.092980 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 227/472] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:18 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:19.093119 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-df4f48de-3b70-4c98-8c6d-575946fb05b5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.228287 Jun 16 18:59:19.093227 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d63c28d3-321c-420e-9c6a-78503551bba8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:19.093227 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d63c28d3-321c-420e-9c6a-78503551bba8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:19.093227 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d63c28d3-321c-420e-9c6a-78503551bba8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:19.093227 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d63c28d3-321c-420e-9c6a-78503551bba8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:19.093766 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d63c28d3-321c-420e-9c6a-78503551bba8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:19.094046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d63c28d3-321c-420e-9c6a-78503551bba8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:19.094541 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 246/473] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:18 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:19.098088 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=100 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:19.222911 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d63c28d3-321c-420e-9c6a-78503551bba8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:19.231677 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d63c28d3-321c-420e-9c6a-78503551bba8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:19.233218 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d63c28d3-321c-420e-9c6a-78503551bba8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:19.234678 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d63c28d3-321c-420e-9c6a-78503551bba8 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1809 microversion: 2.20 time: 0.152529 Jun 16 18:59:19.235239 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 228/474] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:19 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:20.097116 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0a893de6-cd0a-4392-b997-4226fd381b50 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:20.097793 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0a893de6-cd0a-4392-b997-4226fd381b50 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:20.100020 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-7ca3168c-ae63-4d47-a826-b04b0219f857 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:20.100631 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-7ca3168c-ae63-4d47-a826-b04b0219f857 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:20.103930 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a893de6-cd0a-4392-b997-4226fd381b50 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:20.104378 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a893de6-cd0a-4392-b997-4226fd381b50 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:20.105145 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a893de6-cd0a-4392-b997-4226fd381b50 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:20.105609 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a893de6-cd0a-4392-b997-4226fd381b50 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:20.107253 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7ca3168c-ae63-4d47-a826-b04b0219f857 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:20.107732 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7ca3168c-ae63-4d47-a826-b04b0219f857 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:20.108492 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7ca3168c-ae63-4d47-a826-b04b0219f857 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:20.108921 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7ca3168c-ae63-4d47-a826-b04b0219f857 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:20.301056 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0a893de6-cd0a-4392-b997-4226fd381b50 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:20.305659 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-7ca3168c-ae63-4d47-a826-b04b0219f857 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:20.308533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0a893de6-cd0a-4392-b997-4226fd381b50 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1314 microversion: 2.1 time: 0.215292 Jun 16 18:59:20.309103 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 247/475] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:20 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:20.313553 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-76eaf6a6-3a0b-4f69-8899-7f3d1e77b9e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:20.314153 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-76eaf6a6-3a0b-4f69-8899-7f3d1e77b9e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:20.318067 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-7ca3168c-ae63-4d47-a826-b04b0219f857 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.221708 Jun 16 18:59:20.318804 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 229/476] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:20 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:20.319899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-76eaf6a6-3a0b-4f69-8899-7f3d1e77b9e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:20.320341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-76eaf6a6-3a0b-4f69-8899-7f3d1e77b9e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:20.321101 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-76eaf6a6-3a0b-4f69-8899-7f3d1e77b9e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:20.321570 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-76eaf6a6-3a0b-4f69-8899-7f3d1e77b9e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:20.453696 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-76eaf6a6-3a0b-4f69-8899-7f3d1e77b9e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:20.462327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-76eaf6a6-3a0b-4f69-8899-7f3d1e77b9e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:20.463830 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-76eaf6a6-3a0b-4f69-8899-7f3d1e77b9e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:20.464998 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-76eaf6a6-3a0b-4f69-8899-7f3d1e77b9e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1809 microversion: 2.20 time: 0.154957 Jun 16 18:59:20.465595 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 248/477] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:20 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:20.686083 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-0c1c2c6c-79aa-4bf0-a035-ef88992b13b3 req-5880b7a5-abf4-4c74-ba25-c1bffa4658e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73e2d8a-72b0-45bc-9693-eecf5c504b5b", "name": "network-vif-plugged", "status": "completed", "tag": "0709fc5a-ab77-4d05-928e-4bfc5179ed37"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:20.694865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-0c1c2c6c-79aa-4bf0-a035-ef88992b13b3 req-5880b7a5-abf4-4c74-ba25-c1bffa4658e7 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:20.695310 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-0c1c2c6c-79aa-4bf0-a035-ef88992b13b3 req-5880b7a5-abf4-4c74-ba25-c1bffa4658e7 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:20.705988 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-0c1c2c6c-79aa-4bf0-a035-ef88992b13b3 req-5880b7a5-abf4-4c74-ba25-c1bffa4658e7 service nova] Creating event network-vif-plugged:0709fc5a-ab77-4d05-928e-4bfc5179ed37 for instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b on hv-cinder-84617 Jun 16 18:59:20.711079 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-0c1c2c6c-79aa-4bf0-a035-ef88992b13b3 req-5880b7a5-abf4-4c74-ba25-c1bffa4658e7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028659 Jun 16 18:59:20.711701 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 230/478] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:21.325078 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-94578593-19ff-4b8e-8fe6-1e2ffdd5bd4c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:21.325706 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-94578593-19ff-4b8e-8fe6-1e2ffdd5bd4c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:21.332581 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-94578593-19ff-4b8e-8fe6-1e2ffdd5bd4c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:21.333036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-94578593-19ff-4b8e-8fe6-1e2ffdd5bd4c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:21.333866 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-94578593-19ff-4b8e-8fe6-1e2ffdd5bd4c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:21.334306 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-94578593-19ff-4b8e-8fe6-1e2ffdd5bd4c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:21.335059 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-14f3e1f6-59f0-4ceb-a858-9f7a7a9fc85e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:21.335766 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-14f3e1f6-59f0-4ceb-a858-9f7a7a9fc85e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:21.342414 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-14f3e1f6-59f0-4ceb-a858-9f7a7a9fc85e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:21.343065 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-14f3e1f6-59f0-4ceb-a858-9f7a7a9fc85e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:21.343632 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-14f3e1f6-59f0-4ceb-a858-9f7a7a9fc85e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:21.344070 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-14f3e1f6-59f0-4ceb-a858-9f7a7a9fc85e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:21.596411 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-94578593-19ff-4b8e-8fe6-1e2ffdd5bd4c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:21.603991 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-94578593-19ff-4b8e-8fe6-1e2ffdd5bd4c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1497 microversion: 2.1 time: 0.282738 Jun 16 18:59:21.604891 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 249/479] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:21 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1497 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:21.609990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-cc0e10c9-de21-4b1b-917b-f1fe5758bda1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:21.610868 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-cc0e10c9-de21-4b1b-917b-f1fe5758bda1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:21.617509 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cc0e10c9-de21-4b1b-917b-f1fe5758bda1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:21.617952 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cc0e10c9-de21-4b1b-917b-f1fe5758bda1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:21.618734 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cc0e10c9-de21-4b1b-917b-f1fe5758bda1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:21.619177 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cc0e10c9-de21-4b1b-917b-f1fe5758bda1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:21.620537 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-14f3e1f6-59f0-4ceb-a858-9f7a7a9fc85e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:21.629454 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-14f3e1f6-59f0-4ceb-a858-9f7a7a9fc85e tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.298460 Jun 16 18:59:21.633296 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 231/480] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:21 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:21.751204 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cc0e10c9-de21-4b1b-917b-f1fe5758bda1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:21.760443 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cc0e10c9-de21-4b1b-917b-f1fe5758bda1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:21.762554 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cc0e10c9-de21-4b1b-917b-f1fe5758bda1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:21.763723 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-cc0e10c9-de21-4b1b-917b-f1fe5758bda1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1751 microversion: 2.20 time: 0.157790 Jun 16 18:59:21.764269 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 250/481] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:21 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:22.489610 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6a1492f2-9d73-4bba-a177-0e1db94b620a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:22.490114 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6a1492f2-9d73-4bba-a177-0e1db94b620a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:22.496501 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6a1492f2-9d73-4bba-a177-0e1db94b620a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:22.496955 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6a1492f2-9d73-4bba-a177-0e1db94b620a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:22.497752 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6a1492f2-9d73-4bba-a177-0e1db94b620a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:22.498194 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6a1492f2-9d73-4bba-a177-0e1db94b620a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:22.522400 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6a1492f2-9d73-4bba-a177-0e1db94b620a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Going to try to terminate instance {{(pid=130230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:59:22.646312 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1293caba-dcd6-48dd-aab6-919a5fe9d5e2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:22.646876 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-1293caba-dcd6-48dd-aab6-919a5fe9d5e2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:22.652929 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1293caba-dcd6-48dd-aab6-919a5fe9d5e2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:22.653440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1293caba-dcd6-48dd-aab6-919a5fe9d5e2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:22.654249 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1293caba-dcd6-48dd-aab6-919a5fe9d5e2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:22.656317 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1293caba-dcd6-48dd-aab6-919a5fe9d5e2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:22.754030 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6a1492f2-9d73-4bba-a177-0e1db94b620a tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "DELETE /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 204 len: 0 microversion: 2.1 time: 0.268703 Jun 16 18:59:22.754723 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 232/482] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 18:59:22 2022] DELETE /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:59:22.766564 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a7b321f5-8a19-47c4-84e2-0d7edb6bc233 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:22.767772 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a7b321f5-8a19-47c4-84e2-0d7edb6bc233 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:22.774527 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a7b321f5-8a19-47c4-84e2-0d7edb6bc233 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:22.777838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a7b321f5-8a19-47c4-84e2-0d7edb6bc233 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:22.777838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a7b321f5-8a19-47c4-84e2-0d7edb6bc233 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:22.777838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a7b321f5-8a19-47c4-84e2-0d7edb6bc233 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:22.791110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1293caba-dcd6-48dd-aab6-919a5fe9d5e2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:22.798790 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-1293caba-dcd6-48dd-aab6-919a5fe9d5e2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.156381 Jun 16 18:59:22.799355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 251/483] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:22 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:22.803835 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4c49d443-a9ed-4a73-9e0b-713ecf66bd03 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:22.805907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4c49d443-a9ed-4a73-9e0b-713ecf66bd03 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:22.810335 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4c49d443-a9ed-4a73-9e0b-713ecf66bd03 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:22.810785 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4c49d443-a9ed-4a73-9e0b-713ecf66bd03 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:22.811564 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4c49d443-a9ed-4a73-9e0b-713ecf66bd03 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:22.811998 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4c49d443-a9ed-4a73-9e0b-713ecf66bd03 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:22.957945 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a7b321f5-8a19-47c4-84e2-0d7edb6bc233 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:22.965969 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a7b321f5-8a19-47c4-84e2-0d7edb6bc233 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1503 microversion: 2.1 time: 0.203182 Jun 16 18:59:22.966398 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 233/484] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:22 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:22.993540 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4c49d443-a9ed-4a73-9e0b-713ecf66bd03 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:23.002502 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4c49d443-a9ed-4a73-9e0b-713ecf66bd03 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:23.004015 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4c49d443-a9ed-4a73-9e0b-713ecf66bd03 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:23.029777 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4c49d443-a9ed-4a73-9e0b-713ecf66bd03 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1751 microversion: 2.20 time: 0.204914 Jun 16 18:59:23.029777 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 252/485] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:22 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1751 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:23.815605 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3b43b1f2-f85d-4bed-8f1b-04b5d73a527d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:23.816213 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3b43b1f2-f85d-4bed-8f1b-04b5d73a527d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:23.822593 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3b43b1f2-f85d-4bed-8f1b-04b5d73a527d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:23.823033 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3b43b1f2-f85d-4bed-8f1b-04b5d73a527d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:23.823781 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3b43b1f2-f85d-4bed-8f1b-04b5d73a527d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:23.824215 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3b43b1f2-f85d-4bed-8f1b-04b5d73a527d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:23.952293 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-3b43b1f2-f85d-4bed-8f1b-04b5d73a527d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:23.959898 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3b43b1f2-f85d-4bed-8f1b-04b5d73a527d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1267 microversion: 2.1 time: 0.148814 Jun 16 18:59:23.960456 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 234/486] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:23 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:23.988772 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7a10ef87-fea5-4be7-a3f8-57582a7921a7 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:23.994058 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7a10ef87-fea5-4be7-a3f8-57582a7921a7 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:23.995419 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7a10ef87-fea5-4be7-a3f8-57582a7921a7 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:23.995865 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7a10ef87-fea5-4be7-a3f8-57582a7921a7 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:23.996631 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7a10ef87-fea5-4be7-a3f8-57582a7921a7 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:23.997072 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7a10ef87-fea5-4be7-a3f8-57582a7921a7 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:24.046742 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-572716c3-6334-4c29-8533-ba66fcbd3777 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:24.047273 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-572716c3-6334-4c29-8533-ba66fcbd3777 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:24.055200 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-572716c3-6334-4c29-8533-ba66fcbd3777 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:24.057550 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-572716c3-6334-4c29-8533-ba66fcbd3777 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:24.057550 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-572716c3-6334-4c29-8533-ba66fcbd3777 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:24.057550 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-572716c3-6334-4c29-8533-ba66fcbd3777 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:24.170882 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7a10ef87-fea5-4be7-a3f8-57582a7921a7 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:24.179163 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7a10ef87-fea5-4be7-a3f8-57582a7921a7 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1503 microversion: 2.1 time: 0.195182 Jun 16 18:59:24.179828 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 253/487] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:23 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:24.212643 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-572716c3-6334-4c29-8533-ba66fcbd3777 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:24.221537 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-572716c3-6334-4c29-8533-ba66fcbd3777 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:24.223035 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-572716c3-6334-4c29-8533-ba66fcbd3777 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:24.224186 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-572716c3-6334-4c29-8533-ba66fcbd3777 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1751 microversion: 2.20 time: 0.181407 Jun 16 18:59:24.224749 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 235/488] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:24 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:59:24.976419 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-10380509-1b78-4136-84b5-d29aed7a41d5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:24.977028 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-10380509-1b78-4136-84b5-d29aed7a41d5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:24.983296 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10380509-1b78-4136-84b5-d29aed7a41d5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:24.983744 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10380509-1b78-4136-84b5-d29aed7a41d5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:24.984806 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10380509-1b78-4136-84b5-d29aed7a41d5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:24.985267 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10380509-1b78-4136-84b5-d29aed7a41d5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:25.112627 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-10380509-1b78-4136-84b5-d29aed7a41d5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:25.120209 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-10380509-1b78-4136-84b5-d29aed7a41d5 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1454 microversion: 2.1 time: 0.147715 Jun 16 18:59:25.120774 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 254/489] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:24 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:25.136460 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-080cbce8-c02b-41ce-b512-b5b413a8e8db tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:25.137075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-080cbce8-c02b-41ce-b512-b5b413a8e8db tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:25.144175 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-080cbce8-c02b-41ce-b512-b5b413a8e8db tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:25.144622 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-080cbce8-c02b-41ce-b512-b5b413a8e8db tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:25.145413 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-080cbce8-c02b-41ce-b512-b5b413a8e8db tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:25.145847 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-080cbce8-c02b-41ce-b512-b5b413a8e8db tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:25.195775 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-33e87dc1-d526-427c-aeb7-3339b4c00e04 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:25.196420 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-33e87dc1-d526-427c-aeb7-3339b4c00e04 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:25.202302 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-33e87dc1-d526-427c-aeb7-3339b4c00e04 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:25.202751 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-33e87dc1-d526-427c-aeb7-3339b4c00e04 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:25.203508 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-33e87dc1-d526-427c-aeb7-3339b4c00e04 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:25.203941 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-33e87dc1-d526-427c-aeb7-3339b4c00e04 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:25.316928 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-080cbce8-c02b-41ce-b512-b5b413a8e8db tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:25.324693 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-080cbce8-c02b-41ce-b512-b5b413a8e8db tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1454 microversion: 2.1 time: 0.191962 Jun 16 18:59:25.325288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 236/490] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:25 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1454 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:25.330465 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2a0b1ff9-5083-49b0-bfb2-ac1c840bbd75 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:25.331074 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2a0b1ff9-5083-49b0-bfb2-ac1c840bbd75 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:25.336895 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2a0b1ff9-5083-49b0-bfb2-ac1c840bbd75 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:25.337603 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2a0b1ff9-5083-49b0-bfb2-ac1c840bbd75 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:25.338148 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2a0b1ff9-5083-49b0-bfb2-ac1c840bbd75 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:25.338584 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2a0b1ff9-5083-49b0-bfb2-ac1c840bbd75 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:25.369334 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-33e87dc1-d526-427c-aeb7-3339b4c00e04 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:25.377263 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-33e87dc1-d526-427c-aeb7-3339b4c00e04 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1503 microversion: 2.1 time: 0.184800 Jun 16 18:59:25.381279 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 255/491] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:25 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:25.502649 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2a0b1ff9-5083-49b0-bfb2-ac1c840bbd75 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:25.511825 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2a0b1ff9-5083-49b0-bfb2-ac1c840bbd75 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:25.513348 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2a0b1ff9-5083-49b0-bfb2-ac1c840bbd75 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:25.514503 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2a0b1ff9-5083-49b0-bfb2-ac1c840bbd75 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1751 microversion: 2.20 time: 0.188299 Jun 16 18:59:25.515061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 237/492] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:25 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:26.396696 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-80bd0aec-932a-4f13-b062-7f238588c875 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:26.397915 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-80bd0aec-932a-4f13-b062-7f238588c875 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:26.405685 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-80bd0aec-932a-4f13-b062-7f238588c875 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:26.406380 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-80bd0aec-932a-4f13-b062-7f238588c875 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:26.407383 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-80bd0aec-932a-4f13-b062-7f238588c875 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:26.408475 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-80bd0aec-932a-4f13-b062-7f238588c875 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:26.496034 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-80bd0aec-932a-4f13-b062-7f238588c875 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:26.503797 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-80bd0aec-932a-4f13-b062-7f238588c875 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1461 microversion: 2.1 time: 0.113090 Jun 16 18:59:26.504369 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 256/493] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:26 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1461 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:26.511472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-52c9ccbd-e469-48a8-93c8-3dad5107a3d5 req-12dd679a-bd86-484c-aeb3-7f92130e0ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80e17e79-e3fe-4730-b18f-d9aa0a2ba280", "name": "network-vif-deleted", "tag": "91d816fa-5153-4ca2-a433-bfd341a293f7"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:26.516139 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:26.522086 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-52c9ccbd-e469-48a8-93c8-3dad5107a3d5 req-12dd679a-bd86-484c-aeb3-7f92130e0ca4 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:26.522604 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-52c9ccbd-e469-48a8-93c8-3dad5107a3d5 req-12dd679a-bd86-484c-aeb3-7f92130e0ca4 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:26.533977 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d782c06d-a8ef-4773-92b4-d8b9070a820e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:26.534649 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d782c06d-a8ef-4773-92b4-d8b9070a820e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:26.535187 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-52c9ccbd-e469-48a8-93c8-3dad5107a3d5 req-12dd679a-bd86-484c-aeb3-7f92130e0ca4 service nova] Creating event network-vif-deleted:91d816fa-5153-4ca2-a433-bfd341a293f7 for instance 80e17e79-e3fe-4730-b18f-d9aa0a2ba280 on hv-cinder-84617 Jun 16 18:59:26.540540 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-52c9ccbd-e469-48a8-93c8-3dad5107a3d5 req-12dd679a-bd86-484c-aeb3-7f92130e0ca4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032618 Jun 16 18:59:26.540714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d782c06d-a8ef-4773-92b4-d8b9070a820e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:26.541199 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d782c06d-a8ef-4773-92b4-d8b9070a820e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:26.541704 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 238/494] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:26.542499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d782c06d-a8ef-4773-92b4-d8b9070a820e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:26.543444 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d782c06d-a8ef-4773-92b4-d8b9070a820e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:26.683996 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d782c06d-a8ef-4773-92b4-d8b9070a820e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:26.694212 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d782c06d-a8ef-4773-92b4-d8b9070a820e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:26.695881 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d782c06d-a8ef-4773-92b4-d8b9070a820e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:26.697488 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d782c06d-a8ef-4773-92b4-d8b9070a820e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1751 microversion: 2.20 time: 0.168015 Jun 16 18:59:26.698285 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 257/495] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:26 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:59:27.520519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-ad81b93d-f339-4b6e-8866-c45c3f8cc9b5 req-f69733c1-5216-469e-96d1-9e4b872ca23e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73e2d8a-72b0-45bc-9693-eecf5c504b5b", "tag": "0709fc5a-ab77-4d05-928e-4bfc5179ed37"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:27.521067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b7142eb1-6df7-403a-8e66-8f13105f9b17 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:27.521697 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b7142eb1-6df7-403a-8e66-8f13105f9b17 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:27.528192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7142eb1-6df7-403a-8e66-8f13105f9b17 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:27.529051 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7142eb1-6df7-403a-8e66-8f13105f9b17 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:27.529896 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7142eb1-6df7-403a-8e66-8f13105f9b17 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:27.530027 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-ad81b93d-f339-4b6e-8866-c45c3f8cc9b5 req-f69733c1-5216-469e-96d1-9e4b872ca23e service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:27.530385 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-ad81b93d-f339-4b6e-8866-c45c3f8cc9b5 req-f69733c1-5216-469e-96d1-9e4b872ca23e service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:27.530688 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7142eb1-6df7-403a-8e66-8f13105f9b17 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:27.542941 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-ad81b93d-f339-4b6e-8866-c45c3f8cc9b5 req-f69733c1-5216-469e-96d1-9e4b872ca23e service nova] Creating event network-changed:0709fc5a-ab77-4d05-928e-4bfc5179ed37 for instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b on hv-cinder-84617 Jun 16 18:59:27.548168 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-ad81b93d-f339-4b6e-8866-c45c3f8cc9b5 req-f69733c1-5216-469e-96d1-9e4b872ca23e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031534 Jun 16 18:59:27.549504 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 239/496] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:27.571035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7142eb1-6df7-403a-8e66-8f13105f9b17 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:27.571472 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7142eb1-6df7-403a-8e66-8f13105f9b17 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:27.572322 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-b7142eb1-6df7-403a-8e66-8f13105f9b17 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lazy-loading 'fault' on Instance uuid 80e17e79-e3fe-4730-b18f-d9aa0a2ba280 {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:59:27.575039 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=100 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:27.645633 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b7142eb1-6df7-403a-8e66-8f13105f9b17 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:27.653862 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b7142eb1-6df7-403a-8e66-8f13105f9b17 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 200 len: 1304 microversion: 2.1 time: 0.136724 Jun 16 18:59:27.654886 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 258/497] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:27 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:27.716579 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-46493fac-709f-4b88-a036-c401b5588a70 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:27.717588 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-46493fac-709f-4b88-a036-c401b5588a70 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:27.724695 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-46493fac-709f-4b88-a036-c401b5588a70 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:27.725762 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-46493fac-709f-4b88-a036-c401b5588a70 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:27.726654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-46493fac-709f-4b88-a036-c401b5588a70 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:27.727244 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-46493fac-709f-4b88-a036-c401b5588a70 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:27.954466 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-46493fac-709f-4b88-a036-c401b5588a70 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:27.966719 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-46493fac-709f-4b88-a036-c401b5588a70 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:27.969674 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-46493fac-709f-4b88-a036-c401b5588a70 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:27.971428 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-46493fac-709f-4b88-a036-c401b5588a70 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1751 microversion: 2.20 time: 0.259274 Jun 16 18:59:27.971989 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 240/498] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:27 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1751 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:28.672375 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-dfa50aac-55a8-406f-8813-f82fe62c0ed2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:28.672990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-dfa50aac-55a8-406f-8813-f82fe62c0ed2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: 80e17e79-e3fe-4730-b18f-d9aa0a2ba280] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:28.679283 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dfa50aac-55a8-406f-8813-f82fe62c0ed2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:28.679730 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dfa50aac-55a8-406f-8813-f82fe62c0ed2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:28.680494 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dfa50aac-55a8-406f-8813-f82fe62c0ed2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:28.680935 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dfa50aac-55a8-406f-8813-f82fe62c0ed2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:28.694670 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-dfa50aac-55a8-406f-8813-f82fe62c0ed2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] HTTP exception thrown: Instance 80e17e79-e3fe-4730-b18f-d9aa0a2ba280 could not be found. Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-dfa50aac-55a8-406f-8813-f82fe62c0ed2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Request method failure captured: Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 HTTP/1.1 Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq31kfYdc_hbFwFel4ef8yjT63m9c-A_tz5XVfYZkwHhK7d7Eob9lekn2FgFKKR_QubY_73uqkv_r5vg6zhZGjQmRKT_QXQ5ScS1RsZGnzk8kMBCMhPmPQNtoH-4jHkfFFgXEtw5mbD_au_dnv_CRAUiyA_4pKNLJTC2mdpISXakoRsg Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: c5e5a9406f7f4ccba4aaf2cccf1de07e Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-VolumesActionsTest-1949743194 Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 18:59:28.696288 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 18:59:28.697854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c5e5a9406f7f4ccba4aaf2cccf1de07e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c5e5a9406f7f4ccba4aaf2cccf1de07e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c5e5a9406f7f4ccba4aaf2cccf1de07e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c5e5a9406f7f4ccba4aaf2cccf1de07e"}]}] Jun 16 18:59:28.697854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-VolumesActionsTest-1949743194 Jun 16 18:59:28.697854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: c5e5a9406f7f4ccba4aaf2cccf1de07e Jun 16 18:59:28.697854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-VolumesActionsTest-1949743194 Jun 16 18:59:28.697854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-VolumesActionsTest-1949743194-project Jun 16 18:59:28.697854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 18:59:28.697854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 18:59:28.697854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 325f963f409b4fd68f9ac9a29de4be72 Jun 16 18:59:28.697854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-VolumesActionsTest-1949743194-project Jun 16 18:59:28.697854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 18:59:28.697854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance 80e17e79-e3fe-4730-b18f-d9aa0a2ba280 could not be found. Jun 16 18:59:28.697854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': '80e17e79-e3fe-4730-b18f-d9aa0a2ba280'} Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80e17e79-e3fe-4730-b18f-d9aa0a2ba280 could not be found. Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:59:28.698771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80e17e79-e3fe-4730-b18f-d9aa0a2ba280 could not be found. Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80e17e79-e3fe-4730-b18f-d9aa0a2ba280 could not be found. Jun 16 18:59:28.700188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 18:59:28.701528 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-dfa50aac-55a8-406f-8813-f82fe62c0ed2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Returning 404 to user: Instance 80e17e79-e3fe-4730-b18f-d9aa0a2ba280 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:59:28.701528 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-dfa50aac-55a8-406f-8813-f82fe62c0ed2 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280" status: 404 len: 111 microversion: 2.1 time: 0.029691 Jun 16 18:59:28.701528 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 259/499] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:28 2022] GET /compute/v2.1/servers/80e17e79-e3fe-4730-b18f-d9aa0a2ba280 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:59:28.800711 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-705768987", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "networks": [{"uuid": "38d494d8-3507-4c7f-9260-d84973fd6d03"}]}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:28.850580 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.network.neutron [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] validate_networks() for [('38d494d8-3507-4c7f-9260-d84973fd6d03', None, None, None, None, None)] {{(pid=130230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:59:28.991230 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b5e8414a-a1a8-4b6b-8d4a-3e8632935f49 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:28.991937 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b5e8414a-a1a8-4b6b-8d4a-3e8632935f49 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:28.998195 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5e8414a-a1a8-4b6b-8d4a-3e8632935f49 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:28.998726 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5e8414a-a1a8-4b6b-8d4a-3e8632935f49 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:28.999568 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5e8414a-a1a8-4b6b-8d4a-3e8632935f49 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:29.000086 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5e8414a-a1a8-4b6b-8d4a-3e8632935f49 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:29.369757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b5e8414a-a1a8-4b6b-8d4a-3e8632935f49 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:29.378335 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b5e8414a-a1a8-4b6b-8d4a-3e8632935f49 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:29.379902 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b5e8414a-a1a8-4b6b-8d4a-3e8632935f49 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:29.381058 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b5e8414a-a1a8-4b6b-8d4a-3e8632935f49 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.393754 Jun 16 18:59:29.381775 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 260/500] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:28 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:59:29.462321 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Flavor limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:59:29.462750 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Image limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:59:29.463234 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Flavor pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:59:29.463651 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Image pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:59:29.464215 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:59:29.473752 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:29.474199 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:29.475003 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:29.475442 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:29.492741 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Getting quotas for project c5e5a9406f7f4ccba4aaf2cccf1de07e. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:59:29.496632 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Getting quotas for user 325f963f409b4fd68f9ac9a29de4be72 and project c5e5a9406f7f4ccba4aaf2cccf1de07e. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:59:29.507618 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Going to run 1 instances... {{(pid=130230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:59:29.509877 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:59:29.624228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2246019e-be24-4595-a2bc-a2cd14d2d4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.827811 Jun 16 18:59:29.624932 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 241/501] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 18:59:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:59:29.635081 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b30a444b-b7c0-437f-89cd-113374e566f6 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:29.635724 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b30a444b-b7c0-437f-89cd-113374e566f6 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:29.692106 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b30a444b-b7c0-437f-89cd-113374e566f6 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:29.698823 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b30a444b-b7c0-437f-89cd-113374e566f6 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1213 microversion: 2.1 time: 0.067633 Jun 16 18:59:29.699382 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 261/502] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:29 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:30.399641 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1b99fc74-71d6-467d-a8e6-f7ad951e8fdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:30.400255 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1b99fc74-71d6-467d-a8e6-f7ad951e8fdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:30.407609 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1b99fc74-71d6-467d-a8e6-f7ad951e8fdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:30.408709 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1b99fc74-71d6-467d-a8e6-f7ad951e8fdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:30.409512 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1b99fc74-71d6-467d-a8e6-f7ad951e8fdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:30.409951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1b99fc74-71d6-467d-a8e6-f7ad951e8fdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:30.538546 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1b99fc74-71d6-467d-a8e6-f7ad951e8fdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:30.546885 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1b99fc74-71d6-467d-a8e6-f7ad951e8fdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:30.548401 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1b99fc74-71d6-467d-a8e6-f7ad951e8fdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:30.549620 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1b99fc74-71d6-467d-a8e6-f7ad951e8fdb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.154022 Jun 16 18:59:30.550179 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 242/503] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:30 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:30.715547 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b418d904-3f5f-4609-926f-36d815169f34 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:30.716082 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b418d904-3f5f-4609-926f-36d815169f34 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:30.722125 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b418d904-3f5f-4609-926f-36d815169f34 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:30.722568 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b418d904-3f5f-4609-926f-36d815169f34 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:30.723323 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b418d904-3f5f-4609-926f-36d815169f34 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:30.723753 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b418d904-3f5f-4609-926f-36d815169f34 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:30.784542 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b418d904-3f5f-4609-926f-36d815169f34 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:30.791815 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b418d904-3f5f-4609-926f-36d815169f34 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1217 microversion: 2.1 time: 0.080256 Jun 16 18:59:30.792357 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 262/504] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:30 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:31.567897 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-890f0f93-17bc-4e6c-93c0-5c9c0ed4af28 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:31.572312 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-890f0f93-17bc-4e6c-93c0-5c9c0ed4af28 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:31.575209 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-890f0f93-17bc-4e6c-93c0-5c9c0ed4af28 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:31.575662 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-890f0f93-17bc-4e6c-93c0-5c9c0ed4af28 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:31.576435 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-890f0f93-17bc-4e6c-93c0-5c9c0ed4af28 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:31.576874 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-890f0f93-17bc-4e6c-93c0-5c9c0ed4af28 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:31.790172 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-890f0f93-17bc-4e6c-93c0-5c9c0ed4af28 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:31.799876 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-890f0f93-17bc-4e6c-93c0-5c9c0ed4af28 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:31.805477 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-890f0f93-17bc-4e6c-93c0-5c9c0ed4af28 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:31.805477 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-890f0f93-17bc-4e6c-93c0-5c9c0ed4af28 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.238677 Jun 16 18:59:31.805477 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 243/505] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:31 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:31.807774 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-2590d794-6008-46cd-a790-c00c4c554e5b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:31.808396 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-2590d794-6008-46cd-a790-c00c4c554e5b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:31.810367 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=84 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:31.816346 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2590d794-6008-46cd-a790-c00c4c554e5b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:31.816869 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2590d794-6008-46cd-a790-c00c4c554e5b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:31.817720 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2590d794-6008-46cd-a790-c00c4c554e5b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:31.818162 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2590d794-6008-46cd-a790-c00c4c554e5b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:31.909189 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-2590d794-6008-46cd-a790-c00c4c554e5b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:31.916833 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-2590d794-6008-46cd-a790-c00c4c554e5b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1265 microversion: 2.1 time: 0.112918 Jun 16 18:59:31.917414 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 263/506] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:31 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:32.823037 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-44b56bad-d3a9-4580-a1b2-04306bb1cdd7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:32.823987 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-44b56bad-d3a9-4580-a1b2-04306bb1cdd7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:32.832478 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-44b56bad-d3a9-4580-a1b2-04306bb1cdd7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:32.832927 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-44b56bad-d3a9-4580-a1b2-04306bb1cdd7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:32.833890 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-44b56bad-d3a9-4580-a1b2-04306bb1cdd7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:32.834330 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-44b56bad-d3a9-4580-a1b2-04306bb1cdd7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:32.934599 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a8dc0deb-10ae-4c0b-bdfe-45a57f854309 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:32.935232 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a8dc0deb-10ae-4c0b-bdfe-45a57f854309 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:32.941500 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a8dc0deb-10ae-4c0b-bdfe-45a57f854309 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:32.941737 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a8dc0deb-10ae-4c0b-bdfe-45a57f854309 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:32.942493 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a8dc0deb-10ae-4c0b-bdfe-45a57f854309 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:32.942962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a8dc0deb-10ae-4c0b-bdfe-45a57f854309 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:33.040296 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a8dc0deb-10ae-4c0b-bdfe-45a57f854309 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:33.048221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a8dc0deb-10ae-4c0b-bdfe-45a57f854309 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1283 microversion: 2.1 time: 0.117450 Jun 16 18:59:33.050252 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 264/507] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:32 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1283 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:33.052571 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-44b56bad-d3a9-4580-a1b2-04306bb1cdd7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:33.064127 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-44b56bad-d3a9-4580-a1b2-04306bb1cdd7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:33.065783 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-44b56bad-d3a9-4580-a1b2-04306bb1cdd7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:33.066947 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-44b56bad-d3a9-4580-a1b2-04306bb1cdd7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.248754 Jun 16 18:59:33.078590 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 244/508] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:32 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:34.066896 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-bad45707-3383-498f-8436-bb6b29260d8f tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:34.067513 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-bad45707-3383-498f-8436-bb6b29260d8f tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:34.073896 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bad45707-3383-498f-8436-bb6b29260d8f tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:34.074341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bad45707-3383-498f-8436-bb6b29260d8f tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:34.075109 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bad45707-3383-498f-8436-bb6b29260d8f tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:34.075544 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bad45707-3383-498f-8436-bb6b29260d8f tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:34.088430 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-401df260-872e-44f6-b155-b8d6d1684191 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:34.089214 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-401df260-872e-44f6-b155-b8d6d1684191 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:34.097591 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-401df260-872e-44f6-b155-b8d6d1684191 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:34.098071 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-401df260-872e-44f6-b155-b8d6d1684191 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:34.098836 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-401df260-872e-44f6-b155-b8d6d1684191 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:34.099295 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-401df260-872e-44f6-b155-b8d6d1684191 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:34.275889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-bad45707-3383-498f-8436-bb6b29260d8f tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:34.279829 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-401df260-872e-44f6-b155-b8d6d1684191 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:34.282197 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:34.283657 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-bad45707-3383-498f-8436-bb6b29260d8f tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.221463 Jun 16 18:59:34.284223 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 265/509] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:34 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:34.289424 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-401df260-872e-44f6-b155-b8d6d1684191 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:34.290992 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-401df260-872e-44f6-b155-b8d6d1684191 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:34.292145 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-401df260-872e-44f6-b155-b8d6d1684191 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.210353 Jun 16 18:59:34.292682 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 245/510] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:34 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:59:35.300732 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9e18d566-aa79-4428-b362-23b426fe81a1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:35.301375 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9e18d566-aa79-4428-b362-23b426fe81a1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:35.307454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9e18d566-aa79-4428-b362-23b426fe81a1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:35.307919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9e18d566-aa79-4428-b362-23b426fe81a1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:35.308677 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9e18d566-aa79-4428-b362-23b426fe81a1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:35.309127 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9e18d566-aa79-4428-b362-23b426fe81a1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:35.309757 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a78a9e6f-c33b-4111-b1f6-4c0ea595829d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:35.310372 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a78a9e6f-c33b-4111-b1f6-4c0ea595829d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:35.318068 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a78a9e6f-c33b-4111-b1f6-4c0ea595829d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:35.318517 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a78a9e6f-c33b-4111-b1f6-4c0ea595829d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:35.319285 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a78a9e6f-c33b-4111-b1f6-4c0ea595829d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:35.319719 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a78a9e6f-c33b-4111-b1f6-4c0ea595829d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:35.510294 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9e18d566-aa79-4428-b362-23b426fe81a1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:35.514118 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a78a9e6f-c33b-4111-b1f6-4c0ea595829d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:35.518948 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9e18d566-aa79-4428-b362-23b426fe81a1 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.222011 Jun 16 18:59:35.520074 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 266/511] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:35 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:35.531976 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a78a9e6f-c33b-4111-b1f6-4c0ea595829d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:35.533571 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a78a9e6f-c33b-4111-b1f6-4c0ea595829d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:35.534765 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a78a9e6f-c33b-4111-b1f6-4c0ea595829d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.228816 Jun 16 18:59:35.535501 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 246/512] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:35 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:59:35.698491 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ee494a6c-6ad5-442b-9ba1-76b3f8460502 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:35.699212 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ee494a6c-6ad5-442b-9ba1-76b3f8460502 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:35.705612 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ee494a6c-6ad5-442b-9ba1-76b3f8460502 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:35.706061 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ee494a6c-6ad5-442b-9ba1-76b3f8460502 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:35.706847 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ee494a6c-6ad5-442b-9ba1-76b3f8460502 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:35.707320 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ee494a6c-6ad5-442b-9ba1-76b3f8460502 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:35.840555 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-ee494a6c-6ad5-442b-9ba1-76b3f8460502 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lazy-loading 'services' on Instance uuid 8bad769d-1b62-4d0f-8491-bfae3997a525 {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:59:36.137035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ee494a6c-6ad5-442b-9ba1-76b3f8460502 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/os-volume_attachments/d86e8470-a372-4cd5-9c92-a72e4cc17540" status: 202 len: 0 microversion: 2.1 time: 0.442177 Jun 16 18:59:36.137963 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 267/513] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jun 16 18:59:35 2022] DELETE /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/os-volume_attachments/d86e8470-a372-4cd5-9c92-a72e4cc17540 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:59:36.536658 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-0fa50623-a1ff-418d-9c10-47858d27efff tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:36.537890 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-0fa50623-a1ff-418d-9c10-47858d27efff tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:36.544918 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0fa50623-a1ff-418d-9c10-47858d27efff tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:36.545398 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0fa50623-a1ff-418d-9c10-47858d27efff tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:36.553921 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-960f850f-aca9-4079-8440-e7c711aa4f57 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:36.554579 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-960f850f-aca9-4079-8440-e7c711aa4f57 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:36.558152 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0fa50623-a1ff-418d-9c10-47858d27efff tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:36.558931 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0fa50623-a1ff-418d-9c10-47858d27efff tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:36.561776 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-960f850f-aca9-4079-8440-e7c711aa4f57 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:36.562230 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-960f850f-aca9-4079-8440-e7c711aa4f57 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:36.563027 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-960f850f-aca9-4079-8440-e7c711aa4f57 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:36.563647 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-960f850f-aca9-4079-8440-e7c711aa4f57 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:36.788917 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-0fa50623-a1ff-418d-9c10-47858d27efff tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:36.790110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-960f850f-aca9-4079-8440-e7c711aa4f57 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:36.803981 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-0fa50623-a1ff-418d-9c10-47858d27efff tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.271923 Jun 16 18:59:36.807054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 247/514] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:36 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:36.819840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-960f850f-aca9-4079-8440-e7c711aa4f57 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:36.823332 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-960f850f-aca9-4079-8440-e7c711aa4f57 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:36.823332 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-960f850f-aca9-4079-8440-e7c711aa4f57 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.273179 Jun 16 18:59:36.823717 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 268/515] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:36 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:59:37.820708 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-dd531aa7-e1ae-49fd-a820-c8fd9b88fbe4 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:37.821340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-dd531aa7-e1ae-49fd-a820-c8fd9b88fbe4 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:37.828089 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-dd531aa7-e1ae-49fd-a820-c8fd9b88fbe4 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:37.828533 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-dd531aa7-e1ae-49fd-a820-c8fd9b88fbe4 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:37.829323 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-dd531aa7-e1ae-49fd-a820-c8fd9b88fbe4 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:37.829758 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-dd531aa7-e1ae-49fd-a820-c8fd9b88fbe4 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:37.841271 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-dd686f35-7f7e-46f1-8812-0de17ad4ea59 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:37.843431 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-dd686f35-7f7e-46f1-8812-0de17ad4ea59 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:37.853406 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dd686f35-7f7e-46f1-8812-0de17ad4ea59 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:37.854212 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dd686f35-7f7e-46f1-8812-0de17ad4ea59 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:37.855470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dd686f35-7f7e-46f1-8812-0de17ad4ea59 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:37.856147 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dd686f35-7f7e-46f1-8812-0de17ad4ea59 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:38.053413 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-dd531aa7-e1ae-49fd-a820-c8fd9b88fbe4 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:38.059136 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-dd686f35-7f7e-46f1-8812-0de17ad4ea59 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:38.061500 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-dd531aa7-e1ae-49fd-a820-c8fd9b88fbe4 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.244600 Jun 16 18:59:38.062069 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 248/516] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:37 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:38.065645 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-dd686f35-7f7e-46f1-8812-0de17ad4ea59 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:38.066820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a5099ec7-cf46-494e-95fd-cd88ada1b86b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40b69ccd-6cbe-4c7d-aab0-a69290a51494"}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:38.067428 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-dd686f35-7f7e-46f1-8812-0de17ad4ea59 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:38.068340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a5099ec7-cf46-494e-95fd-cd88ada1b86b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:38.068610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-dd686f35-7f7e-46f1-8812-0de17ad4ea59 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.231270 Jun 16 18:59:38.074839 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a5099ec7-cf46-494e-95fd-cd88ada1b86b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:38.075293 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a5099ec7-cf46-494e-95fd-cd88ada1b86b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:38.076070 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a5099ec7-cf46-494e-95fd-cd88ada1b86b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:38.076617 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a5099ec7-cf46-494e-95fd-cd88ada1b86b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:38.079531 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 269/517] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:37 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:59:39.080822 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ecf7454a-3aa7-4f51-9a62-2a4b62e15b16 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:39.081917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ecf7454a-3aa7-4f51-9a62-2a4b62e15b16 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:39.088532 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ecf7454a-3aa7-4f51-9a62-2a4b62e15b16 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:39.088977 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ecf7454a-3aa7-4f51-9a62-2a4b62e15b16 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:39.089816 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ecf7454a-3aa7-4f51-9a62-2a4b62e15b16 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:39.090283 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ecf7454a-3aa7-4f51-9a62-2a4b62e15b16 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:39.225159 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ecf7454a-3aa7-4f51-9a62-2a4b62e15b16 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:39.232704 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ecf7454a-3aa7-4f51-9a62-2a4b62e15b16 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.157676 Jun 16 18:59:39.242912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 270/518] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:39 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:39.246122 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-31bd2fd7-7b50-4f31-a770-82e5f37df491 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:39.246747 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-31bd2fd7-7b50-4f31-a770-82e5f37df491 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:39.253041 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-31bd2fd7-7b50-4f31-a770-82e5f37df491 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:39.253522 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-31bd2fd7-7b50-4f31-a770-82e5f37df491 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:39.254310 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-31bd2fd7-7b50-4f31-a770-82e5f37df491 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:39.254749 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-31bd2fd7-7b50-4f31-a770-82e5f37df491 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:39.399613 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-31bd2fd7-7b50-4f31-a770-82e5f37df491 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:39.409676 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-31bd2fd7-7b50-4f31-a770-82e5f37df491 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:39.411406 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-31bd2fd7-7b50-4f31-a770-82e5f37df491 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:39.412563 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-31bd2fd7-7b50-4f31-a770-82e5f37df491 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.173877 Jun 16 18:59:39.413116 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 271/519] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:39 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:39.483638 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:39.503075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=6 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:40.250700 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-faad9c87-c28a-440e-b279-5def139302ad tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:40.251262 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-faad9c87-c28a-440e-b279-5def139302ad tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:40.253145 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:40.258062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-faad9c87-c28a-440e-b279-5def139302ad tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:40.258509 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-faad9c87-c28a-440e-b279-5def139302ad tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:40.259273 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-faad9c87-c28a-440e-b279-5def139302ad tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:40.259712 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-faad9c87-c28a-440e-b279-5def139302ad tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:40.404869 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-faad9c87-c28a-440e-b279-5def139302ad tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:40.412559 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-faad9c87-c28a-440e-b279-5def139302ad tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.165803 Jun 16 18:59:40.413687 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 272/520] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:40 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:40.430541 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ff3f8480-7a9d-4516-8d1d-8f73a066b656 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:40.431149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ff3f8480-7a9d-4516-8d1d-8f73a066b656 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:40.437623 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff3f8480-7a9d-4516-8d1d-8f73a066b656 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:40.438078 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff3f8480-7a9d-4516-8d1d-8f73a066b656 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:40.438993 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff3f8480-7a9d-4516-8d1d-8f73a066b656 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:40.439481 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff3f8480-7a9d-4516-8d1d-8f73a066b656 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:40.572087 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ff3f8480-7a9d-4516-8d1d-8f73a066b656 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:40.580276 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ff3f8480-7a9d-4516-8d1d-8f73a066b656 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:40.582408 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ff3f8480-7a9d-4516-8d1d-8f73a066b656 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:40.583560 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ff3f8480-7a9d-4516-8d1d-8f73a066b656 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.156921 Jun 16 18:59:40.584361 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 273/521] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:40 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:41.429065 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5571e639-c797-425d-abaa-43d2945dce92 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:41.429894 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5571e639-c797-425d-abaa-43d2945dce92 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:41.435977 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5571e639-c797-425d-abaa-43d2945dce92 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:41.436413 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5571e639-c797-425d-abaa-43d2945dce92 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:41.437174 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5571e639-c797-425d-abaa-43d2945dce92 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:41.437626 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5571e639-c797-425d-abaa-43d2945dce92 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:41.595561 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5571e639-c797-425d-abaa-43d2945dce92 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:41.603172 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5571e639-c797-425d-abaa-43d2945dce92 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.177895 Jun 16 18:59:41.603731 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 274/522] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:41 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:41.608203 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-98ad7c20-8fea-4bec-b7c9-c7c923e256ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:41.608801 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-98ad7c20-8fea-4bec-b7c9-c7c923e256ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:41.615135 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-98ad7c20-8fea-4bec-b7c9-c7c923e256ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:41.615583 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-98ad7c20-8fea-4bec-b7c9-c7c923e256ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:41.616346 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-98ad7c20-8fea-4bec-b7c9-c7c923e256ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:41.616828 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-98ad7c20-8fea-4bec-b7c9-c7c923e256ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:41.758633 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-98ad7c20-8fea-4bec-b7c9-c7c923e256ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:41.767465 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-98ad7c20-8fea-4bec-b7c9-c7c923e256ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:41.769525 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-98ad7c20-8fea-4bec-b7c9-c7c923e256ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:41.775041 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-98ad7c20-8fea-4bec-b7c9-c7c923e256ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.170259 Jun 16 18:59:41.775741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 275/523] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:41 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:42.622515 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-22c8f109-6601-49f7-b214-ce8f5214b9e5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:42.624084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-22c8f109-6601-49f7-b214-ce8f5214b9e5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:42.632588 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-22c8f109-6601-49f7-b214-ce8f5214b9e5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:42.633445 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-22c8f109-6601-49f7-b214-ce8f5214b9e5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:42.634335 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-22c8f109-6601-49f7-b214-ce8f5214b9e5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:42.634851 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-22c8f109-6601-49f7-b214-ce8f5214b9e5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:42.639185 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:42.776741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-22c8f109-6601-49f7-b214-ce8f5214b9e5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:42.784056 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-22c8f109-6601-49f7-b214-ce8f5214b9e5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.167963 Jun 16 18:59:42.785152 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 276/524] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:42 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:42.793973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-54226454-4157-407e-a7e8-793b5fbb93d4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:42.794973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-54226454-4157-407e-a7e8-793b5fbb93d4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:42.801795 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-54226454-4157-407e-a7e8-793b5fbb93d4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:42.802243 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-54226454-4157-407e-a7e8-793b5fbb93d4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:42.803048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-54226454-4157-407e-a7e8-793b5fbb93d4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:42.803484 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-54226454-4157-407e-a7e8-793b5fbb93d4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:42.940295 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-54226454-4157-407e-a7e8-793b5fbb93d4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:42.949337 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-54226454-4157-407e-a7e8-793b5fbb93d4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:42.950854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-54226454-4157-407e-a7e8-793b5fbb93d4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:42.952116 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-54226454-4157-407e-a7e8-793b5fbb93d4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.162270 Jun 16 18:59:42.952671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 277/525] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:42 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:59:43.801993 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b24cf18c-9552-4633-9f37-f1a5acc9f8a8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:43.802667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b24cf18c-9552-4633-9f37-f1a5acc9f8a8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:43.809052 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b24cf18c-9552-4633-9f37-f1a5acc9f8a8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:43.809541 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b24cf18c-9552-4633-9f37-f1a5acc9f8a8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:43.810318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b24cf18c-9552-4633-9f37-f1a5acc9f8a8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:43.810753 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b24cf18c-9552-4633-9f37-f1a5acc9f8a8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:43.942415 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b24cf18c-9552-4633-9f37-f1a5acc9f8a8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:43.950057 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b24cf18c-9552-4633-9f37-f1a5acc9f8a8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.152345 Jun 16 18:59:43.959243 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 278/526] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:43 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:43.970227 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-86bdf039-556e-4374-8213-5b40a94c46d9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:43.971591 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-86bdf039-556e-4374-8213-5b40a94c46d9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:43.978162 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-86bdf039-556e-4374-8213-5b40a94c46d9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:43.978603 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-86bdf039-556e-4374-8213-5b40a94c46d9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:43.979566 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-86bdf039-556e-4374-8213-5b40a94c46d9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:43.980256 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-86bdf039-556e-4374-8213-5b40a94c46d9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:44.120632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-86bdf039-556e-4374-8213-5b40a94c46d9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:44.129931 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-86bdf039-556e-4374-8213-5b40a94c46d9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:44.131549 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-86bdf039-556e-4374-8213-5b40a94c46d9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:44.132741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-86bdf039-556e-4374-8213-5b40a94c46d9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.166410 Jun 16 18:59:44.133518 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 279/527] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:43 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:44.967555 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-cbef001c-8632-403d-b44a-7d2210cfbf96 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:44.968254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-cbef001c-8632-403d-b44a-7d2210cfbf96 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:44.974680 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cbef001c-8632-403d-b44a-7d2210cfbf96 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:44.975135 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cbef001c-8632-403d-b44a-7d2210cfbf96 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:44.975899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cbef001c-8632-403d-b44a-7d2210cfbf96 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:44.976329 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cbef001c-8632-403d-b44a-7d2210cfbf96 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:45.120538 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cbef001c-8632-403d-b44a-7d2210cfbf96 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:45.124530 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-cbef001c-8632-403d-b44a-7d2210cfbf96 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.160893 Jun 16 18:59:45.128148 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 280/528] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:44 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:45.150999 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-2caf9e49-9526-47a7-983d-ae0e719fc8fe tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:45.151725 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-2caf9e49-9526-47a7-983d-ae0e719fc8fe tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:45.157970 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2caf9e49-9526-47a7-983d-ae0e719fc8fe tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:45.158497 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2caf9e49-9526-47a7-983d-ae0e719fc8fe tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:45.159359 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2caf9e49-9526-47a7-983d-ae0e719fc8fe tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:45.160450 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2caf9e49-9526-47a7-983d-ae0e719fc8fe tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:45.295108 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-2caf9e49-9526-47a7-983d-ae0e719fc8fe tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:45.304984 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-2caf9e49-9526-47a7-983d-ae0e719fc8fe tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:45.306531 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-2caf9e49-9526-47a7-983d-ae0e719fc8fe tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:45.307916 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-2caf9e49-9526-47a7-983d-ae0e719fc8fe tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.160883 Jun 16 18:59:45.308723 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 281/529] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:45 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:59:45.541971 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-70ca440a-c3c4-40af-ac5e-67b4aa238cec tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:45.542839 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-70ca440a-c3c4-40af-ac5e-67b4aa238cec tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:45.549651 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-70ca440a-c3c4-40af-ac5e-67b4aa238cec tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:45.550184 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-70ca440a-c3c4-40af-ac5e-67b4aa238cec tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:45.550962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-70ca440a-c3c4-40af-ac5e-67b4aa238cec tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:45.551516 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-70ca440a-c3c4-40af-ac5e-67b4aa238cec tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:45.649000 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-70ca440a-c3c4-40af-ac5e-67b4aa238cec tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lazy-loading 'services' on Instance uuid c5fb9a14-5c4d-4dcd-9728-85313113a15e {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:59:45.966154 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-70ca440a-c3c4-40af-ac5e-67b4aa238cec tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e/os-volume_attachments/6ac4fe09-c07b-4942-a946-a3aa0c0e6c61" status: 202 len: 0 microversion: 2.1 time: 0.431810 Jun 16 18:59:45.966743 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 282/530] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jun 16 18:59:45 2022] DELETE /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e/os-volume_attachments/6ac4fe09-c07b-4942-a946-a3aa0c0e6c61 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:59:46.141711 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1c3fcf3b-4d2d-4e6b-b48f-60767855d859 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:46.142519 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-1c3fcf3b-4d2d-4e6b-b48f-60767855d859 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:46.148825 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1c3fcf3b-4d2d-4e6b-b48f-60767855d859 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:46.149301 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1c3fcf3b-4d2d-4e6b-b48f-60767855d859 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:46.150074 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1c3fcf3b-4d2d-4e6b-b48f-60767855d859 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:46.150508 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1c3fcf3b-4d2d-4e6b-b48f-60767855d859 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:46.280376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1c3fcf3b-4d2d-4e6b-b48f-60767855d859 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:46.287727 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-1c3fcf3b-4d2d-4e6b-b48f-60767855d859 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.150238 Jun 16 18:59:46.288286 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 283/531] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:46 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:46.325827 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b5a13183-90ae-49db-9143-9659a1f819f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:46.326428 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b5a13183-90ae-49db-9143-9659a1f819f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:46.332238 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5a13183-90ae-49db-9143-9659a1f819f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:46.332688 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5a13183-90ae-49db-9143-9659a1f819f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:46.333479 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5a13183-90ae-49db-9143-9659a1f819f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:46.333911 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5a13183-90ae-49db-9143-9659a1f819f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:46.458207 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b5a13183-90ae-49db-9143-9659a1f819f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:46.466466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b5a13183-90ae-49db-9143-9659a1f819f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:46.467978 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b5a13183-90ae-49db-9143-9659a1f819f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:46.469137 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b5a13183-90ae-49db-9143-9659a1f819f2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.147026 Jun 16 18:59:46.469722 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 284/532] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:46 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:59:47.255660 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-97677dc5-adf3-46f2-a528-5cea87eb21cc req-1e8b81b9-ac05-4671-9feb-4c6e5e5b1ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d500eb77-0c7f-432b-8afb-de6928841d70", "tag": "ce5e1fce-b3a0-4096-bf84-cf289217d8d3"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:47.265048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-97677dc5-adf3-46f2-a528-5cea87eb21cc req-1e8b81b9-ac05-4671-9feb-4c6e5e5b1ee8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:47.265574 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-97677dc5-adf3-46f2-a528-5cea87eb21cc req-1e8b81b9-ac05-4671-9feb-4c6e5e5b1ee8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:47.279468 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-97677dc5-adf3-46f2-a528-5cea87eb21cc req-1e8b81b9-ac05-4671-9feb-4c6e5e5b1ee8 service nova] Creating event network-changed:ce5e1fce-b3a0-4096-bf84-cf289217d8d3 for instance d500eb77-0c7f-432b-8afb-de6928841d70 on hv-cinder-84617 Jun 16 18:59:47.282703 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-97677dc5-adf3-46f2-a528-5cea87eb21cc req-1e8b81b9-ac05-4671-9feb-4c6e5e5b1ee8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032391 Jun 16 18:59:47.283245 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 285/533] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:47.313187 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9c37f907-0331-43c7-984d-ddcc7f797eaa tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:47.313935 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9c37f907-0331-43c7-984d-ddcc7f797eaa tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:47.321626 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9c37f907-0331-43c7-984d-ddcc7f797eaa tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:47.322273 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9c37f907-0331-43c7-984d-ddcc7f797eaa tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:47.323126 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9c37f907-0331-43c7-984d-ddcc7f797eaa tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:47.323704 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9c37f907-0331-43c7-984d-ddcc7f797eaa tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:47.473173 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9c37f907-0331-43c7-984d-ddcc7f797eaa tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:47.480935 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9c37f907-0331-43c7-984d-ddcc7f797eaa tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.179192 Jun 16 18:59:47.481725 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 286/534] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:47 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:47.494253 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b114e12e-3779-415b-921e-3702c80a61d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:47.497076 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b114e12e-3779-415b-921e-3702c80a61d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:47.500700 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b114e12e-3779-415b-921e-3702c80a61d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:47.501132 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b114e12e-3779-415b-921e-3702c80a61d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:47.501912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b114e12e-3779-415b-921e-3702c80a61d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:47.502342 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b114e12e-3779-415b-921e-3702c80a61d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:47.633562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b114e12e-3779-415b-921e-3702c80a61d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:47.642121 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b114e12e-3779-415b-921e-3702c80a61d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:47.643610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b114e12e-3779-415b-921e-3702c80a61d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:47.644747 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b114e12e-3779-415b-921e-3702c80a61d1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.154255 Jun 16 18:59:47.645322 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 287/535] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:47 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:47.833853 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a5099ec7-cf46-494e-95fd-cd88ada1b86b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "POST /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.770490 Jun 16 18:59:47.834588 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 249/536] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jun 16 18:59:38 2022] POST /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-volume_attachments => generated 194 bytes in 9772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:48.498341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e206e093-b194-4a5d-bd5d-1ae25660656e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:48.498947 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e206e093-b194-4a5d-bd5d-1ae25660656e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:48.505579 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e206e093-b194-4a5d-bd5d-1ae25660656e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:48.506020 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e206e093-b194-4a5d-bd5d-1ae25660656e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:48.506771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e206e093-b194-4a5d-bd5d-1ae25660656e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:48.507198 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e206e093-b194-4a5d-bd5d-1ae25660656e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:48.661101 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:48.665707 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2cddae7b-ddb9-48df-add5-8a8203b39440 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:48.666447 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2cddae7b-ddb9-48df-add5-8a8203b39440 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:48.675432 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e206e093-b194-4a5d-bd5d-1ae25660656e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:48.675950 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2cddae7b-ddb9-48df-add5-8a8203b39440 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:48.677031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2cddae7b-ddb9-48df-add5-8a8203b39440 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:48.677946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2cddae7b-ddb9-48df-add5-8a8203b39440 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:48.678390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2cddae7b-ddb9-48df-add5-8a8203b39440 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:48.683461 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e206e093-b194-4a5d-bd5d-1ae25660656e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.188925 Jun 16 18:59:48.684056 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 288/537] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:48 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:48.894735 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2cddae7b-ddb9-48df-add5-8a8203b39440 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:48.903863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2cddae7b-ddb9-48df-add5-8a8203b39440 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:48.905407 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2cddae7b-ddb9-48df-add5-8a8203b39440 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:48.906646 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2cddae7b-ddb9-48df-add5-8a8203b39440 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.247536 Jun 16 18:59:48.907147 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 250/538] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:48 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:59:49.190083 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-bb9be8d5-d255-47b2-b090-62ada6cd7f8b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:49.193858 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-bb9be8d5-d255-47b2-b090-62ada6cd7f8b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:49.196619 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bb9be8d5-d255-47b2-b090-62ada6cd7f8b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:49.197067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bb9be8d5-d255-47b2-b090-62ada6cd7f8b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:49.197863 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bb9be8d5-d255-47b2-b090-62ada6cd7f8b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:49.198299 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bb9be8d5-d255-47b2-b090-62ada6cd7f8b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:49.225508 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-bb9be8d5-d255-47b2-b090-62ada6cd7f8b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Going to try to terminate instance {{(pid=130229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:59:49.480310 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-bb9be8d5-d255-47b2-b090-62ada6cd7f8b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "DELETE /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 204 len: 0 microversion: 2.1 time: 0.293651 Jun 16 18:59:49.480908 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 289/539] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 18:59:49 2022] DELETE /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:59:49.490267 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d2980f9d-b359-4280-95ec-8d518b164819 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:49.490886 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d2980f9d-b359-4280-95ec-8d518b164819 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:49.497323 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d2980f9d-b359-4280-95ec-8d518b164819 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:49.497778 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d2980f9d-b359-4280-95ec-8d518b164819 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:49.498548 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d2980f9d-b359-4280-95ec-8d518b164819 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:49.498983 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d2980f9d-b359-4280-95ec-8d518b164819 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:49.627654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d2980f9d-b359-4280-95ec-8d518b164819 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:49.635223 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d2980f9d-b359-4280-95ec-8d518b164819 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1513 microversion: 2.1 time: 0.149966 Jun 16 18:59:49.638211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 251/540] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:49 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:49.700569 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8371cb18-9750-41ef-8fe2-7bfcf5ea8b19 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:49.701284 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8371cb18-9750-41ef-8fe2-7bfcf5ea8b19 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:49.707301 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8371cb18-9750-41ef-8fe2-7bfcf5ea8b19 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:49.708250 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8371cb18-9750-41ef-8fe2-7bfcf5ea8b19 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:49.709051 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8371cb18-9750-41ef-8fe2-7bfcf5ea8b19 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:49.709507 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8371cb18-9750-41ef-8fe2-7bfcf5ea8b19 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:49.841721 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8371cb18-9750-41ef-8fe2-7bfcf5ea8b19 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:49.849007 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8371cb18-9750-41ef-8fe2-7bfcf5ea8b19 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.152706 Jun 16 18:59:49.849590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 290/541] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:49 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:49.925677 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-bc147179-7492-48d1-9dfd-11449774e705 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:49.926852 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-bc147179-7492-48d1-9dfd-11449774e705 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:49.932949 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bc147179-7492-48d1-9dfd-11449774e705 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:49.933429 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bc147179-7492-48d1-9dfd-11449774e705 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:49.934191 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bc147179-7492-48d1-9dfd-11449774e705 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:49.934627 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bc147179-7492-48d1-9dfd-11449774e705 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:49.995797 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-50cd45d3-d60b-4ba6-b255-1d3d98a70b05 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:50.003722 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-50cd45d3-d60b-4ba6-b255-1d3d98a70b05 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.004906 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-50cd45d3-d60b-4ba6-b255-1d3d98a70b05 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:50.009637 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:50.028697 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-50cd45d3-d60b-4ba6-b255-1d3d98a70b05 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Going to try to stop instance {{(pid=130229) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 18:59:50.071047 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-bc147179-7492-48d1-9dfd-11449774e705 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:50.079453 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-bc147179-7492-48d1-9dfd-11449774e705 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:50.080958 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-bc147179-7492-48d1-9dfd-11449774e705 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:50.082147 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-bc147179-7492-48d1-9dfd-11449774e705 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.160415 Jun 16 18:59:50.082741 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 252/542] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:49 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:50.231798 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-50cd45d3-d60b-4ba6-b255-1d3d98a70b05 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "POST /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/action" status: 202 len: 0 microversion: 2.1 time: 0.239837 Jun 16 18:59:50.232395 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 291/543] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jun 16 18:59:49 2022] POST /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 18:59:50.241116 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2624ee47-432b-453d-a607-134c3d26ec57 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:50.243351 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2624ee47-432b-453d-a607-134c3d26ec57 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:50.248040 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2624ee47-432b-453d-a607-134c3d26ec57 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.248485 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2624ee47-432b-453d-a607-134c3d26ec57 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:50.249304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2624ee47-432b-453d-a607-134c3d26ec57 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.249740 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2624ee47-432b-453d-a607-134c3d26ec57 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:50.382658 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2624ee47-432b-453d-a607-134c3d26ec57 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:50.390194 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2624ee47-432b-453d-a607-134c3d26ec57 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1675 microversion: 2.1 time: 0.153449 Jun 16 18:59:50.390767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 253/544] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:50 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:50.652742 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-16ce7e34-9024-4003-9364-fd51a5317748 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:50.653369 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-16ce7e34-9024-4003-9364-fd51a5317748 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:50.659596 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-16ce7e34-9024-4003-9364-fd51a5317748 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.660044 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-16ce7e34-9024-4003-9364-fd51a5317748 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:50.661342 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-16ce7e34-9024-4003-9364-fd51a5317748 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.661781 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-16ce7e34-9024-4003-9364-fd51a5317748 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:50.791713 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-16ce7e34-9024-4003-9364-fd51a5317748 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:50.799207 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-16ce7e34-9024-4003-9364-fd51a5317748 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1513 microversion: 2.1 time: 0.150978 Jun 16 18:59:50.799772 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 292/545] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:50 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:50.865765 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-446b07b5-beff-49bf-869c-4ad92866138e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:50.866388 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-446b07b5-beff-49bf-869c-4ad92866138e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:50.873726 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-446b07b5-beff-49bf-869c-4ad92866138e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.874186 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-446b07b5-beff-49bf-869c-4ad92866138e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:50.874970 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-446b07b5-beff-49bf-869c-4ad92866138e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.875464 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-446b07b5-beff-49bf-869c-4ad92866138e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:51.010456 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-446b07b5-beff-49bf-869c-4ad92866138e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:51.018048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-446b07b5-beff-49bf-869c-4ad92866138e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.156571 Jun 16 18:59:51.018624 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 254/546] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:50 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:51.100383 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5e1a33ca-8601-41fa-86d8-9435a2cc7889 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:51.101187 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5e1a33ca-8601-41fa-86d8-9435a2cc7889 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:51.112051 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5e1a33ca-8601-41fa-86d8-9435a2cc7889 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:51.112525 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5e1a33ca-8601-41fa-86d8-9435a2cc7889 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:51.113364 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5e1a33ca-8601-41fa-86d8-9435a2cc7889 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:51.113810 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5e1a33ca-8601-41fa-86d8-9435a2cc7889 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:51.263543 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5e1a33ca-8601-41fa-86d8-9435a2cc7889 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:51.272602 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5e1a33ca-8601-41fa-86d8-9435a2cc7889 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:51.274258 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5e1a33ca-8601-41fa-86d8-9435a2cc7889 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:51.275409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5e1a33ca-8601-41fa-86d8-9435a2cc7889 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.179478 Jun 16 18:59:51.275965 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 293/547] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:51 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:51.407494 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1cd8c192-87ca-4e5a-bc64-0c13f96321e7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:51.408114 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1cd8c192-87ca-4e5a-bc64-0c13f96321e7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:51.414793 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cd8c192-87ca-4e5a-bc64-0c13f96321e7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:51.415506 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cd8c192-87ca-4e5a-bc64-0c13f96321e7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:51.417760 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cd8c192-87ca-4e5a-bc64-0c13f96321e7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:51.418209 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cd8c192-87ca-4e5a-bc64-0c13f96321e7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:51.555521 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1cd8c192-87ca-4e5a-bc64-0c13f96321e7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:51.563304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1cd8c192-87ca-4e5a-bc64-0c13f96321e7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1675 microversion: 2.1 time: 0.159635 Jun 16 18:59:51.564039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 255/548] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:51 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:51.816551 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c6a28ee5-0a1b-4fff-85dc-b17282b63b93 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:51.817169 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c6a28ee5-0a1b-4fff-85dc-b17282b63b93 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:51.823572 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c6a28ee5-0a1b-4fff-85dc-b17282b63b93 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:51.824141 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c6a28ee5-0a1b-4fff-85dc-b17282b63b93 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:51.824939 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c6a28ee5-0a1b-4fff-85dc-b17282b63b93 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:51.825405 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c6a28ee5-0a1b-4fff-85dc-b17282b63b93 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:51.959686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c6a28ee5-0a1b-4fff-85dc-b17282b63b93 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:51.966104 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c6a28ee5-0a1b-4fff-85dc-b17282b63b93 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1513 microversion: 2.1 time: 0.153461 Jun 16 18:59:51.966716 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 294/549] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:51 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:52.035328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3e367876-d4b1-4890-9ea2-90e27b8f5f5c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:52.035867 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3e367876-d4b1-4890-9ea2-90e27b8f5f5c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:52.042346 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3e367876-d4b1-4890-9ea2-90e27b8f5f5c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:52.042820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3e367876-d4b1-4890-9ea2-90e27b8f5f5c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:52.043629 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3e367876-d4b1-4890-9ea2-90e27b8f5f5c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:52.044058 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3e367876-d4b1-4890-9ea2-90e27b8f5f5c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:52.176266 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-3e367876-d4b1-4890-9ea2-90e27b8f5f5c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:52.183664 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3e367876-d4b1-4890-9ea2-90e27b8f5f5c tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.152401 Jun 16 18:59:52.184224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 256/550] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:52 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:52.294273 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-48b58fc4-661d-4966-b82f-6e22110f521d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:52.294806 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-48b58fc4-661d-4966-b82f-6e22110f521d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:52.301131 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-48b58fc4-661d-4966-b82f-6e22110f521d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:52.301637 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-48b58fc4-661d-4966-b82f-6e22110f521d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:52.302414 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-48b58fc4-661d-4966-b82f-6e22110f521d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:52.302848 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-48b58fc4-661d-4966-b82f-6e22110f521d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:52.433917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-48b58fc4-661d-4966-b82f-6e22110f521d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:52.442864 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-48b58fc4-661d-4966-b82f-6e22110f521d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:52.444364 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-48b58fc4-661d-4966-b82f-6e22110f521d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:52.445535 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-48b58fc4-661d-4966-b82f-6e22110f521d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.155356 Jun 16 18:59:52.446088 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 295/551] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:52 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:52.580561 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6d1d2786-1f4b-4614-b202-4d9ebfc7c72e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:52.581176 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6d1d2786-1f4b-4614-b202-4d9ebfc7c72e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:52.587419 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d1d2786-1f4b-4614-b202-4d9ebfc7c72e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:52.587870 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d1d2786-1f4b-4614-b202-4d9ebfc7c72e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:52.588657 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d1d2786-1f4b-4614-b202-4d9ebfc7c72e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:52.589104 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d1d2786-1f4b-4614-b202-4d9ebfc7c72e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:52.760823 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6d1d2786-1f4b-4614-b202-4d9ebfc7c72e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:52.768301 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6d1d2786-1f4b-4614-b202-4d9ebfc7c72e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1675 microversion: 2.1 time: 0.191648 Jun 16 18:59:52.768870 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 257/552] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:52 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1675 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:52.988405 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6760e70a-40bc-4f87-bc1f-dd449c8caa5d tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:52.989658 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6760e70a-40bc-4f87-bc1f-dd449c8caa5d tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:52.995590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6760e70a-40bc-4f87-bc1f-dd449c8caa5d tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:52.996036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6760e70a-40bc-4f87-bc1f-dd449c8caa5d tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:52.996795 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6760e70a-40bc-4f87-bc1f-dd449c8caa5d tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:52.997229 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6760e70a-40bc-4f87-bc1f-dd449c8caa5d tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:53.128097 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6760e70a-40bc-4f87-bc1f-dd449c8caa5d tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:53.135490 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6760e70a-40bc-4f87-bc1f-dd449c8caa5d tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1513 microversion: 2.1 time: 0.151395 Jun 16 18:59:53.136055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 296/553] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:52 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:53.200633 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d047a30a-ee90-49b3-b57c-5456a1e0e525 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:53.201268 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d047a30a-ee90-49b3-b57c-5456a1e0e525 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:53.208264 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d047a30a-ee90-49b3-b57c-5456a1e0e525 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:53.208713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d047a30a-ee90-49b3-b57c-5456a1e0e525 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:53.209518 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d047a30a-ee90-49b3-b57c-5456a1e0e525 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:53.209956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d047a30a-ee90-49b3-b57c-5456a1e0e525 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:53.336009 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d047a30a-ee90-49b3-b57c-5456a1e0e525 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:53.343492 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d047a30a-ee90-49b3-b57c-5456a1e0e525 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.146739 Jun 16 18:59:53.344256 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 258/554] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:53 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:53.463868 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-cfdbeb5f-af5e-4d28-ac01-42fdd0f0977f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:53.464491 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-cfdbeb5f-af5e-4d28-ac01-42fdd0f0977f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:53.470460 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cfdbeb5f-af5e-4d28-ac01-42fdd0f0977f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:53.470911 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cfdbeb5f-af5e-4d28-ac01-42fdd0f0977f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:53.471678 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cfdbeb5f-af5e-4d28-ac01-42fdd0f0977f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:53.472119 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cfdbeb5f-af5e-4d28-ac01-42fdd0f0977f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:53.597586 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cfdbeb5f-af5e-4d28-ac01-42fdd0f0977f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:53.606453 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cfdbeb5f-af5e-4d28-ac01-42fdd0f0977f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:53.607970 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cfdbeb5f-af5e-4d28-ac01-42fdd0f0977f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:53.609122 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-cfdbeb5f-af5e-4d28-ac01-42fdd0f0977f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.149327 Jun 16 18:59:53.609806 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 297/555] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:53 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:53.787589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6fd06b0d-1b57-40ac-bc6b-e848f4c285c2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:53.788220 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6fd06b0d-1b57-40ac-bc6b-e848f4c285c2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:53.795056 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6fd06b0d-1b57-40ac-bc6b-e848f4c285c2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:53.795565 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6fd06b0d-1b57-40ac-bc6b-e848f4c285c2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:53.796350 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6fd06b0d-1b57-40ac-bc6b-e848f4c285c2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:53.796881 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6fd06b0d-1b57-40ac-bc6b-e848f4c285c2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:53.900708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-a67b5077-dd60-40d6-a28a-a079a1fc4ca0 req-5b8c5b69-2bc5-434f-a94f-cb4d95d18c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d500eb77-0c7f-432b-8afb-de6928841d70", "name": "network-vif-plugged", "status": "completed", "tag": "ce5e1fce-b3a0-4096-bf84-cf289217d8d3"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:53.908797 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-a67b5077-dd60-40d6-a28a-a079a1fc4ca0 req-5b8c5b69-2bc5-434f-a94f-cb4d95d18c66 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:53.909269 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-a67b5077-dd60-40d6-a28a-a079a1fc4ca0 req-5b8c5b69-2bc5-434f-a94f-cb4d95d18c66 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:53.920698 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-a67b5077-dd60-40d6-a28a-a079a1fc4ca0 req-5b8c5b69-2bc5-434f-a94f-cb4d95d18c66 service nova] Creating event network-vif-plugged:ce5e1fce-b3a0-4096-bf84-cf289217d8d3 for instance d500eb77-0c7f-432b-8afb-de6928841d70 on hv-cinder-84617 Jun 16 18:59:53.925488 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-a67b5077-dd60-40d6-a28a-a079a1fc4ca0 req-5b8c5b69-2bc5-434f-a94f-cb4d95d18c66 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028430 Jun 16 18:59:53.928522 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 298/556] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:59:54.010279 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6fd06b0d-1b57-40ac-bc6b-e848f4c285c2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:54.019922 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6fd06b0d-1b57-40ac-bc6b-e848f4c285c2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1675 microversion: 2.1 time: 0.236726 Jun 16 18:59:54.019922 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 259/557] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:53 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1675 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:54.152970 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7f9dc5d5-2abd-4d69-9f80-d8ff6ffb254c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:54.158627 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7f9dc5d5-2abd-4d69-9f80-d8ff6ffb254c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:54.162276 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7f9dc5d5-2abd-4d69-9f80-d8ff6ffb254c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:54.162857 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7f9dc5d5-2abd-4d69-9f80-d8ff6ffb254c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:54.163664 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7f9dc5d5-2abd-4d69-9f80-d8ff6ffb254c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:54.164175 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7f9dc5d5-2abd-4d69-9f80-d8ff6ffb254c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:54.236579 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-033ee016-56cc-43d4-a77d-fa67ea860452 req-bd3b95d2-72be-4c89-a7f2-9a76a669bfad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5fb9a14-5c4d-4dcd-9728-85313113a15e", "name": "network-vif-deleted", "tag": "80388b4f-0d36-43aa-8acd-308c5eefc7ba"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:54.245149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7f9dc5d5-2abd-4d69-9f80-d8ff6ffb254c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:54.247383 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-033ee016-56cc-43d4-a77d-fa67ea860452 req-bd3b95d2-72be-4c89-a7f2-9a76a669bfad service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:54.247822 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-033ee016-56cc-43d4-a77d-fa67ea860452 req-bd3b95d2-72be-4c89-a7f2-9a76a669bfad service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:54.253033 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7f9dc5d5-2abd-4d69-9f80-d8ff6ffb254c tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1471 microversion: 2.1 time: 0.104395 Jun 16 18:59:54.253883 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 299/558] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:54 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1471 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:54.269782 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-033ee016-56cc-43d4-a77d-fa67ea860452 req-bd3b95d2-72be-4c89-a7f2-9a76a669bfad service nova] Creating event network-vif-deleted:80388b4f-0d36-43aa-8acd-308c5eefc7ba for instance c5fb9a14-5c4d-4dcd-9728-85313113a15e on hv-cinder-84617 Jun 16 18:59:54.275960 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-033ee016-56cc-43d4-a77d-fa67ea860452 req-bd3b95d2-72be-4c89-a7f2-9a76a669bfad service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043320 Jun 16 18:59:54.276597 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 260/559] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:54.359982 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-96f43eec-3928-4331-b708-908a09138ffe tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:54.360525 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-96f43eec-3928-4331-b708-908a09138ffe tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:54.367378 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-96f43eec-3928-4331-b708-908a09138ffe tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:54.367820 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-96f43eec-3928-4331-b708-908a09138ffe tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:54.368578 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-96f43eec-3928-4331-b708-908a09138ffe tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:54.369009 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-96f43eec-3928-4331-b708-908a09138ffe tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:54.496682 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-96f43eec-3928-4331-b708-908a09138ffe tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:54.504364 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-96f43eec-3928-4331-b708-908a09138ffe tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.148250 Jun 16 18:59:54.504976 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 300/560] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:54 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:54.628626 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-26a9d3d9-14e9-4e6e-898e-505d1ae53f5b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:54.629264 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-26a9d3d9-14e9-4e6e-898e-505d1ae53f5b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:54.635488 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-26a9d3d9-14e9-4e6e-898e-505d1ae53f5b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:54.635936 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-26a9d3d9-14e9-4e6e-898e-505d1ae53f5b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:54.636709 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-26a9d3d9-14e9-4e6e-898e-505d1ae53f5b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:54.637147 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-26a9d3d9-14e9-4e6e-898e-505d1ae53f5b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:54.772511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-26a9d3d9-14e9-4e6e-898e-505d1ae53f5b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:54.774842 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:54.781745 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-26a9d3d9-14e9-4e6e-898e-505d1ae53f5b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:54.783235 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-26a9d3d9-14e9-4e6e-898e-505d1ae53f5b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:54.784528 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-26a9d3d9-14e9-4e6e-898e-505d1ae53f5b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.160278 Jun 16 18:59:54.785419 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 261/561] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:54 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:55.036656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c07628eb-85c9-4650-ad42-78fb2815caea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:55.037199 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c07628eb-85c9-4650-ad42-78fb2815caea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:55.043471 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c07628eb-85c9-4650-ad42-78fb2815caea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:55.043925 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c07628eb-85c9-4650-ad42-78fb2815caea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:55.044693 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c07628eb-85c9-4650-ad42-78fb2815caea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:55.045132 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c07628eb-85c9-4650-ad42-78fb2815caea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:55.169118 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c07628eb-85c9-4650-ad42-78fb2815caea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:55.177261 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c07628eb-85c9-4650-ad42-78fb2815caea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1675 microversion: 2.1 time: 0.144635 Jun 16 18:59:55.177826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 301/562] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:55 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:55.271226 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3df5419e-57b1-48d7-b971-ab600493c73b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:55.271993 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3df5419e-57b1-48d7-b971-ab600493c73b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:55.279508 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3df5419e-57b1-48d7-b971-ab600493c73b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:55.279680 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3df5419e-57b1-48d7-b971-ab600493c73b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:55.280442 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3df5419e-57b1-48d7-b971-ab600493c73b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:55.280878 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3df5419e-57b1-48d7-b971-ab600493c73b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:55.314344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3df5419e-57b1-48d7-b971-ab600493c73b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:55.314797 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3df5419e-57b1-48d7-b971-ab600493c73b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:55.315260 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.objects.instance [None req-3df5419e-57b1-48d7-b971-ab600493c73b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lazy-loading 'fault' on Instance uuid c5fb9a14-5c4d-4dcd-9728-85313113a15e {{(pid=130230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:59:55.358921 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-3df5419e-57b1-48d7-b971-ab600493c73b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:55.366727 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3df5419e-57b1-48d7-b971-ab600493c73b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1308 microversion: 2.1 time: 0.099493 Jun 16 18:59:55.367358 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 262/563] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:55 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:55.521480 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ae20b98c-83c5-44f2-aa1e-bcf650cf77f5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:55.522095 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ae20b98c-83c5-44f2-aa1e-bcf650cf77f5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:55.528049 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ae20b98c-83c5-44f2-aa1e-bcf650cf77f5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:55.528494 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ae20b98c-83c5-44f2-aa1e-bcf650cf77f5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:55.529272 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ae20b98c-83c5-44f2-aa1e-bcf650cf77f5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:55.529711 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ae20b98c-83c5-44f2-aa1e-bcf650cf77f5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:55.662303 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ae20b98c-83c5-44f2-aa1e-bcf650cf77f5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:55.669883 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ae20b98c-83c5-44f2-aa1e-bcf650cf77f5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1313 microversion: 2.1 time: 0.152738 Jun 16 18:59:55.670561 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 302/564] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:55 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:55.804175 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9df74f67-aad3-40e9-8b57-e7260f8ee176 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:55.804995 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9df74f67-aad3-40e9-8b57-e7260f8ee176 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:55.811904 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9df74f67-aad3-40e9-8b57-e7260f8ee176 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:55.814469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9df74f67-aad3-40e9-8b57-e7260f8ee176 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:55.814469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9df74f67-aad3-40e9-8b57-e7260f8ee176 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:55.814469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9df74f67-aad3-40e9-8b57-e7260f8ee176 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:55.947963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9df74f67-aad3-40e9-8b57-e7260f8ee176 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:55.956568 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9df74f67-aad3-40e9-8b57-e7260f8ee176 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:55.958810 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9df74f67-aad3-40e9-8b57-e7260f8ee176 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:55.959971 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9df74f67-aad3-40e9-8b57-e7260f8ee176 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.160185 Jun 16 18:59:55.960531 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 263/565] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:55 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:56.195409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3f5c21ee-8356-4c15-bcd6-90b6644234ee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:56.196021 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3f5c21ee-8356-4c15-bcd6-90b6644234ee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:56.202209 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3f5c21ee-8356-4c15-bcd6-90b6644234ee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:56.202673 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3f5c21ee-8356-4c15-bcd6-90b6644234ee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:56.203423 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3f5c21ee-8356-4c15-bcd6-90b6644234ee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:56.203858 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3f5c21ee-8356-4c15-bcd6-90b6644234ee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:56.347431 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3f5c21ee-8356-4c15-bcd6-90b6644234ee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:56.360693 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3f5c21ee-8356-4c15-bcd6-90b6644234ee tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1675 microversion: 2.1 time: 0.169688 Jun 16 18:59:56.374251 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 303/566] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:56 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:56.383810 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-81aefa6a-bbf2-4140-a319-b4f84a784afc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:56.384443 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-81aefa6a-bbf2-4140-a319-b4f84a784afc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:56.391269 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-81aefa6a-bbf2-4140-a319-b4f84a784afc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:56.393036 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-81aefa6a-bbf2-4140-a319-b4f84a784afc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:56.393036 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-81aefa6a-bbf2-4140-a319-b4f84a784afc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:56.393036 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-81aefa6a-bbf2-4140-a319-b4f84a784afc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:56.424141 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-81aefa6a-bbf2-4140-a319-b4f84a784afc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:56.424593 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-81aefa6a-bbf2-4140-a319-b4f84a784afc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:56.425054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.objects.instance [None req-81aefa6a-bbf2-4140-a319-b4f84a784afc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lazy-loading 'fault' on Instance uuid c5fb9a14-5c4d-4dcd-9728-85313113a15e {{(pid=130230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:59:56.468368 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-81aefa6a-bbf2-4140-a319-b4f84a784afc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:56.475676 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-81aefa6a-bbf2-4140-a319-b4f84a784afc tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 200 len: 1308 microversion: 2.1 time: 0.096284 Jun 16 18:59:56.476237 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 264/567] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:56 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:56.686971 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9bbc8fe8-c882-4673-9f1f-976de7317c00 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:56.687516 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9bbc8fe8-c882-4673-9f1f-976de7317c00 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:56.693545 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9bbc8fe8-c882-4673-9f1f-976de7317c00 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:56.694000 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9bbc8fe8-c882-4673-9f1f-976de7317c00 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:56.694765 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9bbc8fe8-c882-4673-9f1f-976de7317c00 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:56.695205 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9bbc8fe8-c882-4673-9f1f-976de7317c00 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:56.825010 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-9bbc8fe8-c882-4673-9f1f-976de7317c00 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:56.833064 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9bbc8fe8-c882-4673-9f1f-976de7317c00 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1496 microversion: 2.1 time: 0.149421 Jun 16 18:59:56.834779 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 304/568] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:56 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1496 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:56.978802 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f77ee1b6-aee6-4c65-8ff6-9b68c4ce88e9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:56.979390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f77ee1b6-aee6-4c65-8ff6-9b68c4ce88e9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:56.985473 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f77ee1b6-aee6-4c65-8ff6-9b68c4ce88e9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:56.985916 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f77ee1b6-aee6-4c65-8ff6-9b68c4ce88e9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:56.986956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f77ee1b6-aee6-4c65-8ff6-9b68c4ce88e9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:56.987443 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f77ee1b6-aee6-4c65-8ff6-9b68c4ce88e9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:57.114174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f77ee1b6-aee6-4c65-8ff6-9b68c4ce88e9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:57.122863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f77ee1b6-aee6-4c65-8ff6-9b68c4ce88e9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:57.124372 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f77ee1b6-aee6-4c65-8ff6-9b68c4ce88e9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:57.125551 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f77ee1b6-aee6-4c65-8ff6-9b68c4ce88e9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.150881 Jun 16 18:59:57.126108 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 265/569] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:56 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:57.378970 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6dcce249-e93b-4ca9-887d-5bf0202dc5ba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:57.380095 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6dcce249-e93b-4ca9-887d-5bf0202dc5ba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:57.386058 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6dcce249-e93b-4ca9-887d-5bf0202dc5ba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:57.386504 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6dcce249-e93b-4ca9-887d-5bf0202dc5ba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:57.387418 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6dcce249-e93b-4ca9-887d-5bf0202dc5ba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:57.387858 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6dcce249-e93b-4ca9-887d-5bf0202dc5ba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:57.492747 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ceb7d31b-d189-4b42-9013-e622f81b00ce tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:57.493381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ceb7d31b-d189-4b42-9013-e622f81b00ce tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: c5fb9a14-5c4d-4dcd-9728-85313113a15e] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:57.500379 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ceb7d31b-d189-4b42-9013-e622f81b00ce tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:57.500821 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ceb7d31b-d189-4b42-9013-e622f81b00ce tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:57.501661 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ceb7d31b-d189-4b42-9013-e622f81b00ce tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:57.502094 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ceb7d31b-d189-4b42-9013-e622f81b00ce tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:57.516289 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-ceb7d31b-d189-4b42-9013-e622f81b00ce tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] HTTP exception thrown: Instance c5fb9a14-5c4d-4dcd-9728-85313113a15e could not be found. Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ceb7d31b-d189-4b42-9013-e622f81b00ce tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Request method failure captured: Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e HTTP/1.1 Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq30uLM9uoMqMdFD01g1zD5OkzCfnlHOtjJsW8Ml037RRLthLFbGfiBd0oOoS5wJDouJPCxnB_j0mvIUZIo7iH18emFdSM4PkSdBoH3HNhG2euwhT1hGhwz1ocT3BUkTKvKoa9JN5USpO-dNZAyAF8k0XM8_n0lI1P_cEvDZfP_VGRlM Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: e16a74b1bc56455b8f60bfc28bc94afb Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-VolumesSnapshotTestJSON-129707427 Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 18:59:57.517963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 18:59:57.528309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e16a74b1bc56455b8f60bfc28bc94afb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e16a74b1bc56455b8f60bfc28bc94afb", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e16a74b1bc56455b8f60bfc28bc94afb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e16a74b1bc56455b8f60bfc28bc94afb"}]}] Jun 16 18:59:57.528309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-VolumesSnapshotTestJSON-129707427 Jun 16 18:59:57.528309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: e16a74b1bc56455b8f60bfc28bc94afb Jun 16 18:59:57.528309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-129707427 Jun 16 18:59:57.528309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-VolumesSnapshotTestJSON-129707427-project Jun 16 18:59:57.528309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 18:59:57.528309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 18:59:57.528309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: eed09fa6ecf14635949417f19c8a3af0 Jun 16 18:59:57.528309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-VolumesSnapshotTestJSON-129707427-project Jun 16 18:59:57.528309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 18:59:57.528309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance c5fb9a14-5c4d-4dcd-9728-85313113a15e could not be found. Jun 16 18:59:57.528309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': 'c5fb9a14-5c4d-4dcd-9728-85313113a15e'} Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5fb9a14-5c4d-4dcd-9728-85313113a15e could not be found. Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:59:57.529224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5fb9a14-5c4d-4dcd-9728-85313113a15e could not be found. Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5fb9a14-5c4d-4dcd-9728-85313113a15e could not be found. Jun 16 18:59:57.530476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 18:59:57.531561 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ceb7d31b-d189-4b42-9013-e622f81b00ce tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Returning 404 to user: Instance c5fb9a14-5c4d-4dcd-9728-85313113a15e could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:59:57.531561 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ceb7d31b-d189-4b42-9013-e622f81b00ce tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e" status: 404 len: 111 microversion: 2.1 time: 0.030793 Jun 16 18:59:57.531561 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 266/570] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:57 2022] GET /compute/v2.1/servers/c5fb9a14-5c4d-4dcd-9728-85313113a15e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 18:59:57.531766 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6dcce249-e93b-4ca9-887d-5bf0202dc5ba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:57.536560 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6dcce249-e93b-4ca9-887d-5bf0202dc5ba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1675 microversion: 2.1 time: 0.161564 Jun 16 18:59:57.545887 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 305/571] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:57 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:57.655474 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-cc4ada47-6e04-4e72-8271-989dc966c3ed tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:57.656547 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-cc4ada47-6e04-4e72-8271-989dc966c3ed tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:57.667556 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cc4ada47-6e04-4e72-8271-989dc966c3ed tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:57.670526 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cc4ada47-6e04-4e72-8271-989dc966c3ed tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:57.671901 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cc4ada47-6e04-4e72-8271-989dc966c3ed tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:57.672876 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cc4ada47-6e04-4e72-8271-989dc966c3ed tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:57.706891 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-cc4ada47-6e04-4e72-8271-989dc966c3ed tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Going to try to terminate instance {{(pid=130230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 18:59:57.723202 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4f6f3fa5-3b07-46bd-b398-f362e2063e3b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:57.724518 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4f6f3fa5-3b07-46bd-b398-f362e2063e3b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:57.730750 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4f6f3fa5-3b07-46bd-b398-f362e2063e3b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:57.732745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4f6f3fa5-3b07-46bd-b398-f362e2063e3b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:57.732745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4f6f3fa5-3b07-46bd-b398-f362e2063e3b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:57.732745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4f6f3fa5-3b07-46bd-b398-f362e2063e3b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:57.763107 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-4f6f3fa5-3b07-46bd-b398-f362e2063e3b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lazy-loading 'flavor' on Instance uuid 88123824-1b55-41ca-a29f-0d3e0edd3d1d {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 18:59:57.843903 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:57.978647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-cc4ada47-6e04-4e72-8271-989dc966c3ed tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 204 len: 0 microversion: 2.1 time: 0.328514 Jun 16 18:59:57.979481 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 267/572] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 18:59:57 2022] DELETE /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 18:59:57.988278 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-a2a72645-4760-4066-8344-fa31d92aa27c req-36853194-32a3-4588-b9c7-48fe7943cafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c04798-b061-421b-9b61-db9cce7dace4", "name": "network-vif-plugged", "status": "completed", "tag": "44fe652d-5231-4810-99fa-21c58c429e9c"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:57.999819 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-a2a72645-4760-4066-8344-fa31d92aa27c req-36853194-32a3-4588-b9c7-48fe7943cafc service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.000524 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-a2a72645-4760-4066-8344-fa31d92aa27c req-36853194-32a3-4588-b9c7-48fe7943cafc service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.014111 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-a2a72645-4760-4066-8344-fa31d92aa27c req-36853194-32a3-4588-b9c7-48fe7943cafc service nova] Creating event network-vif-plugged:44fe652d-5231-4810-99fa-21c58c429e9c for instance d6c04798-b061-421b-9b61-db9cce7dace4 on hv-cinder-84617 Jun 16 18:59:58.020463 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-a2a72645-4760-4066-8344-fa31d92aa27c req-36853194-32a3-4588-b9c7-48fe7943cafc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037712 Jun 16 18:59:58.021050 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 268/573] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 18:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:58.027450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e70678d6-acc3-4f48-a5c3-bdfc5cfed4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:58.028461 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e70678d6-acc3-4f48-a5c3-bdfc5cfed4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:58.034795 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e70678d6-acc3-4f48-a5c3-bdfc5cfed4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.035246 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e70678d6-acc3-4f48-a5c3-bdfc5cfed4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.036540 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e70678d6-acc3-4f48-a5c3-bdfc5cfed4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.036977 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e70678d6-acc3-4f48-a5c3-bdfc5cfed4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.045142 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4f6f3fa5-3b07-46bd-b398-f362e2063e3b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "POST /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/action" status: 200 len: 32 microversion: 2.1 time: 0.326273 Jun 16 18:59:58.047821 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 306/574] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jun 16 18:59:57 2022] POST /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/action => generated 32 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 18:59:58.055679 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c7c8f0bc-bec9-43ee-a2ba-6c9c75bc0bc7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:58.056380 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c7c8f0bc-bec9-43ee-a2ba-6c9c75bc0bc7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:58.065136 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c7c8f0bc-bec9-43ee-a2ba-6c9c75bc0bc7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.065657 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c7c8f0bc-bec9-43ee-a2ba-6c9c75bc0bc7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.066451 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c7c8f0bc-bec9-43ee-a2ba-6c9c75bc0bc7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.066900 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c7c8f0bc-bec9-43ee-a2ba-6c9c75bc0bc7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.235028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e70678d6-acc3-4f48-a5c3-bdfc5cfed4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:58.243424 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e70678d6-acc3-4f48-a5c3-bdfc5cfed4de tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1502 microversion: 2.1 time: 0.221169 Jun 16 18:59:58.243993 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 269/575] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:58 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1502 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:58.248582 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1a683318-5af2-4538-abd4-34e085dd725c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:58.249187 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1a683318-5af2-4538-abd4-34e085dd725c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:58.254142 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c7c8f0bc-bec9-43ee-a2ba-6c9c75bc0bc7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:58.255146 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1a683318-5af2-4538-abd4-34e085dd725c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.255598 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1a683318-5af2-4538-abd4-34e085dd725c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.256392 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1a683318-5af2-4538-abd4-34e085dd725c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.256829 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1a683318-5af2-4538-abd4-34e085dd725c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.262291 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c7c8f0bc-bec9-43ee-a2ba-6c9c75bc0bc7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.211163 Jun 16 18:59:58.262860 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 307/576] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:58 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:58.385131 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1a683318-5af2-4538-abd4-34e085dd725c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:58.393473 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1a683318-5af2-4538-abd4-34e085dd725c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:58.394979 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1a683318-5af2-4538-abd4-34e085dd725c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:58.396655 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1a683318-5af2-4538-abd4-34e085dd725c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.151719 Jun 16 18:59:58.397202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 270/577] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:58 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:58.552859 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5eca0d83-7d45-4d7d-98ba-90d336cc9449 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:58.553502 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5eca0d83-7d45-4d7d-98ba-90d336cc9449 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:58.559506 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5eca0d83-7d45-4d7d-98ba-90d336cc9449 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.559953 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5eca0d83-7d45-4d7d-98ba-90d336cc9449 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.560712 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5eca0d83-7d45-4d7d-98ba-90d336cc9449 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.561142 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5eca0d83-7d45-4d7d-98ba-90d336cc9449 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.692785 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5eca0d83-7d45-4d7d-98ba-90d336cc9449 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:58.700214 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5eca0d83-7d45-4d7d-98ba-90d336cc9449 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1675 microversion: 2.1 time: 0.151164 Jun 16 18:59:58.700775 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 308/578] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:58 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:59.260877 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-bdcff012-e814-460e-803b-54e86d71b9af tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:59.261443 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-bdcff012-e814-460e-803b-54e86d71b9af tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:59.267874 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bdcff012-e814-460e-803b-54e86d71b9af tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:59.268314 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bdcff012-e814-460e-803b-54e86d71b9af tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:59.269065 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bdcff012-e814-460e-803b-54e86d71b9af tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:59.269523 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bdcff012-e814-460e-803b-54e86d71b9af tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:59.279452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3fa2b5f1-2a89-4275-b4b0-cf1449a10dda tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:59.280069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3fa2b5f1-2a89-4275-b4b0-cf1449a10dda tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:59.286259 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3fa2b5f1-2a89-4275-b4b0-cf1449a10dda tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:59.286694 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3fa2b5f1-2a89-4275-b4b0-cf1449a10dda tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:59.287467 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3fa2b5f1-2a89-4275-b4b0-cf1449a10dda tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:59.287907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3fa2b5f1-2a89-4275-b4b0-cf1449a10dda tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:59.452414 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-bdcff012-e814-460e-803b-54e86d71b9af tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:59.459912 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-bdcff012-e814-460e-803b-54e86d71b9af tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1502 microversion: 2.1 time: 0.202950 Jun 16 18:59:59.460486 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 271/579] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:59 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:59.465130 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4c3b8ba1-6e8f-4bb7-be02-4b5dd190f9ce tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:59.465812 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4c3b8ba1-6e8f-4bb7-be02-4b5dd190f9ce tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:59.469322 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3fa2b5f1-2a89-4275-b4b0-cf1449a10dda tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:59.472856 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c3b8ba1-6e8f-4bb7-be02-4b5dd190f9ce tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:59.473850 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c3b8ba1-6e8f-4bb7-be02-4b5dd190f9ce tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:59.474637 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c3b8ba1-6e8f-4bb7-be02-4b5dd190f9ce tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:59.475129 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c3b8ba1-6e8f-4bb7-be02-4b5dd190f9ce tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:59.478871 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3fa2b5f1-2a89-4275-b4b0-cf1449a10dda tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.203272 Jun 16 18:59:59.479433 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 309/580] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:59 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:59.605107 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4c3b8ba1-6e8f-4bb7-be02-4b5dd190f9ce tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:59.613696 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4c3b8ba1-6e8f-4bb7-be02-4b5dd190f9ce tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:59.615836 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4c3b8ba1-6e8f-4bb7-be02-4b5dd190f9ce tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:59.616996 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4c3b8ba1-6e8f-4bb7-be02-4b5dd190f9ce tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.155593 Jun 16 18:59:59.617596 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 272/581] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:59 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:59.717414 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7c8e0bbb-8e85-4cd9-99cb-2f1abf3949b6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:59.718034 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7c8e0bbb-8e85-4cd9-99cb-2f1abf3949b6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:59.719970 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:59.725559 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c8e0bbb-8e85-4cd9-99cb-2f1abf3949b6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:59.726016 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c8e0bbb-8e85-4cd9-99cb-2f1abf3949b6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:59.726779 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c8e0bbb-8e85-4cd9-99cb-2f1abf3949b6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:59.727222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c8e0bbb-8e85-4cd9-99cb-2f1abf3949b6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:59.853943 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7c8e0bbb-8e85-4cd9-99cb-2f1abf3949b6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:59.861227 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7c8e0bbb-8e85-4cd9-99cb-2f1abf3949b6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1675 microversion: 2.1 time: 0.147667 Jun 16 18:59:59.862063 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 310/582] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:59 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:00.475878 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4c47056a-b1e7-443a-b110-b3900713e6b3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:00.476492 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4c47056a-b1e7-443a-b110-b3900713e6b3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:00.482970 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c47056a-b1e7-443a-b110-b3900713e6b3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.483413 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c47056a-b1e7-443a-b110-b3900713e6b3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:00.484165 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c47056a-b1e7-443a-b110-b3900713e6b3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.484597 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c47056a-b1e7-443a-b110-b3900713e6b3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:00.495652 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-16fd9b3a-5b8c-4cba-9006-afa59fa344cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:00.496255 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-16fd9b3a-5b8c-4cba-9006-afa59fa344cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:00.502129 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-16fd9b3a-5b8c-4cba-9006-afa59fa344cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.502576 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-16fd9b3a-5b8c-4cba-9006-afa59fa344cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:00.503336 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-16fd9b3a-5b8c-4cba-9006-afa59fa344cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.503766 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-16fd9b3a-5b8c-4cba-9006-afa59fa344cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:00.680031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4c47056a-b1e7-443a-b110-b3900713e6b3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:00.684003 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-16fd9b3a-5b8c-4cba-9006-afa59fa344cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:00.687733 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4c47056a-b1e7-443a-b110-b3900713e6b3 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1502 microversion: 2.1 time: 0.215695 Jun 16 19:00:00.688295 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 273/583] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:00 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1502 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:00.691773 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-16fd9b3a-5b8c-4cba-9006-afa59fa344cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.199912 Jun 16 19:00:00.693650 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 311/584] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:00 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:00.693802 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4e700160-f470-47d5-9b90-38e2e906800b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:00.694111 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4e700160-f470-47d5-9b90-38e2e906800b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:00.699851 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4e700160-f470-47d5-9b90-38e2e906800b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.700297 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4e700160-f470-47d5-9b90-38e2e906800b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:00.701057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4e700160-f470-47d5-9b90-38e2e906800b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.701583 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4e700160-f470-47d5-9b90-38e2e906800b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:00.828589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4e700160-f470-47d5-9b90-38e2e906800b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:00.836976 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4e700160-f470-47d5-9b90-38e2e906800b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:00.838519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4e700160-f470-47d5-9b90-38e2e906800b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:00.839673 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4e700160-f470-47d5-9b90-38e2e906800b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.150471 Jun 16 19:00:00.840229 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 274/585] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:00 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:00.878155 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-19134a77-f08a-40b4-b261-7438ab85e8b9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:00.878761 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-19134a77-f08a-40b4-b261-7438ab85e8b9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:00.885525 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-19134a77-f08a-40b4-b261-7438ab85e8b9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.885976 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-19134a77-f08a-40b4-b261-7438ab85e8b9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:00.886740 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-19134a77-f08a-40b4-b261-7438ab85e8b9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.887204 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-19134a77-f08a-40b4-b261-7438ab85e8b9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:01.018186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-19134a77-f08a-40b4-b261-7438ab85e8b9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:01.026024 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-19134a77-f08a-40b4-b261-7438ab85e8b9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1675 microversion: 2.1 time: 0.151604 Jun 16 19:00:01.026610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 312/586] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:00 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:01.707453 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a4e5c3ad-6db9-4636-8277-7f17dc55fae8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:01.708234 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a4e5c3ad-6db9-4636-8277-7f17dc55fae8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:01.709710 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c5b45379-9d1f-429a-8424-f665684cc785 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:01.711357 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c5b45379-9d1f-429a-8424-f665684cc785 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:01.717426 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a4e5c3ad-6db9-4636-8277-7f17dc55fae8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:01.717877 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a4e5c3ad-6db9-4636-8277-7f17dc55fae8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:01.724453 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a4e5c3ad-6db9-4636-8277-7f17dc55fae8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:01.724453 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a4e5c3ad-6db9-4636-8277-7f17dc55fae8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:01.724660 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c5b45379-9d1f-429a-8424-f665684cc785 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:01.724660 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c5b45379-9d1f-429a-8424-f665684cc785 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:01.724660 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c5b45379-9d1f-429a-8424-f665684cc785 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:01.724660 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c5b45379-9d1f-429a-8424-f665684cc785 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:02.092254 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a4e5c3ad-6db9-4636-8277-7f17dc55fae8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:02.101043 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a4e5c3ad-6db9-4636-8277-7f17dc55fae8 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1502 microversion: 2.1 time: 0.399915 Jun 16 19:00:02.109437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 275/587] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:01 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1502 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:02.109437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f52fc81b-930d-4cf1-8136-ec4785d3917e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:02.109437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f52fc81b-930d-4cf1-8136-ec4785d3917e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:02.113318 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f52fc81b-930d-4cf1-8136-ec4785d3917e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:02.113867 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f52fc81b-930d-4cf1-8136-ec4785d3917e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:02.114733 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f52fc81b-930d-4cf1-8136-ec4785d3917e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:02.115285 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f52fc81b-930d-4cf1-8136-ec4785d3917e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:02.345183 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c5b45379-9d1f-429a-8424-f665684cc785 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:02.358206 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c5b45379-9d1f-429a-8424-f665684cc785 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.652723 Jun 16 19:00:02.358983 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 313/588] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:01 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:02.373336 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5352f2a0-5669-4a03-a956-61ea0277cda2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:02.374113 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5352f2a0-5669-4a03-a956-61ea0277cda2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:02.380070 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5352f2a0-5669-4a03-a956-61ea0277cda2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:02.380564 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5352f2a0-5669-4a03-a956-61ea0277cda2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:02.381472 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5352f2a0-5669-4a03-a956-61ea0277cda2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:02.381956 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5352f2a0-5669-4a03-a956-61ea0277cda2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:02.585850 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f52fc81b-930d-4cf1-8136-ec4785d3917e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:02.595394 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f52fc81b-930d-4cf1-8136-ec4785d3917e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:02.596932 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f52fc81b-930d-4cf1-8136-ec4785d3917e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:02.598182 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f52fc81b-930d-4cf1-8136-ec4785d3917e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.495483 Jun 16 19:00:02.598748 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 276/589] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:02 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:02.629466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5352f2a0-5669-4a03-a956-61ea0277cda2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:02.638467 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5352f2a0-5669-4a03-a956-61ea0277cda2 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1675 microversion: 2.1 time: 0.268924 Jun 16 19:00:02.639107 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 314/590] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:02 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1675 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:02.918701 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-279a60a2-62f7-4fb3-8ff5-165618581f2c req-03604671-e969-4ca0-949b-23d8d5637589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d500eb77-0c7f-432b-8afb-de6928841d70", "name": "network-vif-deleted", "tag": "ce5e1fce-b3a0-4096-bf84-cf289217d8d3"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:02.927477 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-279a60a2-62f7-4fb3-8ff5-165618581f2c req-03604671-e969-4ca0-949b-23d8d5637589 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:02.927928 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-279a60a2-62f7-4fb3-8ff5-165618581f2c req-03604671-e969-4ca0-949b-23d8d5637589 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:02.939034 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-279a60a2-62f7-4fb3-8ff5-165618581f2c req-03604671-e969-4ca0-949b-23d8d5637589 service nova] Creating event network-vif-deleted:ce5e1fce-b3a0-4096-bf84-cf289217d8d3 for instance d500eb77-0c7f-432b-8afb-de6928841d70 on hv-cinder-84617 Jun 16 19:00:02.943909 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-279a60a2-62f7-4fb3-8ff5-165618581f2c req-03604671-e969-4ca0-949b-23d8d5637589 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028894 Jun 16 19:00:02.944511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 277/591] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:00:03.118360 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e0690167-3b84-4e5d-ba55-3bd02399b5ea tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:03.119183 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e0690167-3b84-4e5d-ba55-3bd02399b5ea tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:03.125396 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e0690167-3b84-4e5d-ba55-3bd02399b5ea tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:03.126084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e0690167-3b84-4e5d-ba55-3bd02399b5ea tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:03.126861 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e0690167-3b84-4e5d-ba55-3bd02399b5ea tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:03.127299 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e0690167-3b84-4e5d-ba55-3bd02399b5ea tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:03.195080 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e0690167-3b84-4e5d-ba55-3bd02399b5ea tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:03.202671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e0690167-3b84-4e5d-ba55-3bd02399b5ea tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1298 microversion: 2.1 time: 0.088677 Jun 16 19:00:03.203230 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 315/592] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:03 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:03.376325 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-12490cdf-eda8-4ca9-bc2c-6f37d5707243 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:03.377025 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-12490cdf-eda8-4ca9-bc2c-6f37d5707243 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:03.383697 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-12490cdf-eda8-4ca9-bc2c-6f37d5707243 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:03.384139 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-12490cdf-eda8-4ca9-bc2c-6f37d5707243 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:03.384907 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-12490cdf-eda8-4ca9-bc2c-6f37d5707243 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:03.385377 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-12490cdf-eda8-4ca9-bc2c-6f37d5707243 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:03.388063 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:03.514490 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-12490cdf-eda8-4ca9-bc2c-6f37d5707243 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:03.522481 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-12490cdf-eda8-4ca9-bc2c-6f37d5707243 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.150401 Jun 16 19:00:03.523043 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 278/593] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:03 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:03.616478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-37fdedd0-2499-4af9-ad32-a43353792f1b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:03.617059 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-37fdedd0-2499-4af9-ad32-a43353792f1b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:03.623035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-37fdedd0-2499-4af9-ad32-a43353792f1b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:03.623478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-37fdedd0-2499-4af9-ad32-a43353792f1b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:03.624269 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-37fdedd0-2499-4af9-ad32-a43353792f1b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:03.624700 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-37fdedd0-2499-4af9-ad32-a43353792f1b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:03.656907 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-38b76097-15e1-49ca-98c2-e1f48cce3cec tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:03.657651 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-38b76097-15e1-49ca-98c2-e1f48cce3cec tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:03.671108 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-38b76097-15e1-49ca-98c2-e1f48cce3cec tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:03.671640 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-38b76097-15e1-49ca-98c2-e1f48cce3cec tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:03.672491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-38b76097-15e1-49ca-98c2-e1f48cce3cec tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:03.672989 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-38b76097-15e1-49ca-98c2-e1f48cce3cec tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:03.847013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-37fdedd0-2499-4af9-ad32-a43353792f1b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:03.857519 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-37fdedd0-2499-4af9-ad32-a43353792f1b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:03.859025 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-37fdedd0-2499-4af9-ad32-a43353792f1b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:03.860187 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-37fdedd0-2499-4af9-ad32-a43353792f1b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.248133 Jun 16 19:00:03.860752 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 316/594] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:03 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:03.878689 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-38b76097-15e1-49ca-98c2-e1f48cce3cec tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:03.886211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-38b76097-15e1-49ca-98c2-e1f48cce3cec tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1675 microversion: 2.1 time: 0.233409 Jun 16 19:00:03.886788 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 279/595] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:03 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1675 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:04.219763 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4686b7d8-a3cb-4d96-8143-d3f6387fa02b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:04.220621 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4686b7d8-a3cb-4d96-8143-d3f6387fa02b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:04.227143 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4686b7d8-a3cb-4d96-8143-d3f6387fa02b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:04.227593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4686b7d8-a3cb-4d96-8143-d3f6387fa02b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:04.228357 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4686b7d8-a3cb-4d96-8143-d3f6387fa02b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:04.228793 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4686b7d8-a3cb-4d96-8143-d3f6387fa02b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:04.259452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4686b7d8-a3cb-4d96-8143-d3f6387fa02b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:04.259903 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4686b7d8-a3cb-4d96-8143-d3f6387fa02b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:04.260381 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-4686b7d8-a3cb-4d96-8143-d3f6387fa02b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lazy-loading 'fault' on Instance uuid d500eb77-0c7f-432b-8afb-de6928841d70 {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:00:04.302461 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4686b7d8-a3cb-4d96-8143-d3f6387fa02b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:04.310099 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4686b7d8-a3cb-4d96-8143-d3f6387fa02b tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1303 microversion: 2.1 time: 0.094161 Jun 16 19:00:04.310659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 317/596] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:04 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:04.540113 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d3596ecf-04db-4c3a-81f6-cc0f6067aa5d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:04.540658 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d3596ecf-04db-4c3a-81f6-cc0f6067aa5d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:04.547311 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d3596ecf-04db-4c3a-81f6-cc0f6067aa5d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:04.547760 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d3596ecf-04db-4c3a-81f6-cc0f6067aa5d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:04.548536 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d3596ecf-04db-4c3a-81f6-cc0f6067aa5d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:04.554676 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d3596ecf-04db-4c3a-81f6-cc0f6067aa5d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:04.679124 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d3596ecf-04db-4c3a-81f6-cc0f6067aa5d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:04.687324 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d3596ecf-04db-4c3a-81f6-cc0f6067aa5d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.151744 Jun 16 19:00:04.687885 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 280/597] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:04 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:04.878509 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6340d0e4-11da-49c2-8fb7-1361ba5b3595 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:04.879116 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6340d0e4-11da-49c2-8fb7-1361ba5b3595 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:04.885123 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6340d0e4-11da-49c2-8fb7-1361ba5b3595 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:04.885594 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6340d0e4-11da-49c2-8fb7-1361ba5b3595 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:04.886344 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6340d0e4-11da-49c2-8fb7-1361ba5b3595 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:04.886772 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6340d0e4-11da-49c2-8fb7-1361ba5b3595 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:04.903715 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ddc59d5e-5659-42ce-aea4-6181ebb5419e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:04.904335 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ddc59d5e-5659-42ce-aea4-6181ebb5419e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:04.910439 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ddc59d5e-5659-42ce-aea4-6181ebb5419e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:04.910888 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ddc59d5e-5659-42ce-aea4-6181ebb5419e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:04.912180 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ddc59d5e-5659-42ce-aea4-6181ebb5419e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:04.912618 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ddc59d5e-5659-42ce-aea4-6181ebb5419e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:05.078571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6340d0e4-11da-49c2-8fb7-1361ba5b3595 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:05.086354 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ddc59d5e-5659-42ce-aea4-6181ebb5419e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:05.087776 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6340d0e4-11da-49c2-8fb7-1361ba5b3595 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:05.089338 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6340d0e4-11da-49c2-8fb7-1361ba5b3595 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:05.090548 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6340d0e4-11da-49c2-8fb7-1361ba5b3595 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.215941 Jun 16 19:00:05.091118 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 318/598] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:04 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:05.094836 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ddc59d5e-5659-42ce-aea4-6181ebb5419e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1675 microversion: 2.1 time: 0.194815 Jun 16 19:00:05.095416 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 281/599] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:04 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1675 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:05.327437 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5544cf01-2e28-42d9-9dd0-f5a7b14dd56e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:05.327967 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5544cf01-2e28-42d9-9dd0-f5a7b14dd56e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:05.334445 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5544cf01-2e28-42d9-9dd0-f5a7b14dd56e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:05.334886 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5544cf01-2e28-42d9-9dd0-f5a7b14dd56e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:05.335633 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5544cf01-2e28-42d9-9dd0-f5a7b14dd56e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:05.336061 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5544cf01-2e28-42d9-9dd0-f5a7b14dd56e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:05.366527 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5544cf01-2e28-42d9-9dd0-f5a7b14dd56e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:05.366944 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5544cf01-2e28-42d9-9dd0-f5a7b14dd56e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:05.367387 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-5544cf01-2e28-42d9-9dd0-f5a7b14dd56e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lazy-loading 'fault' on Instance uuid d500eb77-0c7f-432b-8afb-de6928841d70 {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:00:05.411842 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5544cf01-2e28-42d9-9dd0-f5a7b14dd56e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:05.419275 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5544cf01-2e28-42d9-9dd0-f5a7b14dd56e tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1303 microversion: 2.1 time: 0.095793 Jun 16 19:00:05.419837 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 319/600] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:05 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:05.704956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5e69032a-264e-4815-bbdd-bb84bcee8025 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:05.705624 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5e69032a-264e-4815-bbdd-bb84bcee8025 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:05.712568 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5e69032a-264e-4815-bbdd-bb84bcee8025 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:05.713016 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5e69032a-264e-4815-bbdd-bb84bcee8025 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:05.713805 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5e69032a-264e-4815-bbdd-bb84bcee8025 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:05.714242 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5e69032a-264e-4815-bbdd-bb84bcee8025 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:05.842333 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5e69032a-264e-4815-bbdd-bb84bcee8025 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:05.850326 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5e69032a-264e-4815-bbdd-bb84bcee8025 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.149255 Jun 16 19:00:05.850894 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 282/601] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:05 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:06.109474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-60386319-c00d-4b63-a1fe-49b629aa99c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:06.110084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-60386319-c00d-4b63-a1fe-49b629aa99c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:06.111750 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-94c3eb25-9fc9-43c7-bdbb-aeb7a89dcb27 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:06.112625 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-94c3eb25-9fc9-43c7-bdbb-aeb7a89dcb27 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:06.116802 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-60386319-c00d-4b63-a1fe-49b629aa99c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.117267 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-60386319-c00d-4b63-a1fe-49b629aa99c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.118036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-60386319-c00d-4b63-a1fe-49b629aa99c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.118471 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-60386319-c00d-4b63-a1fe-49b629aa99c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.119124 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-94c3eb25-9fc9-43c7-bdbb-aeb7a89dcb27 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.119574 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-94c3eb25-9fc9-43c7-bdbb-aeb7a89dcb27 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.120333 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-94c3eb25-9fc9-43c7-bdbb-aeb7a89dcb27 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.120775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-94c3eb25-9fc9-43c7-bdbb-aeb7a89dcb27 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.300398 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-60386319-c00d-4b63-a1fe-49b629aa99c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:06.315343 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-94c3eb25-9fc9-43c7-bdbb-aeb7a89dcb27 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:06.315649 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-60386319-c00d-4b63-a1fe-49b629aa99c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:06.317263 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-60386319-c00d-4b63-a1fe-49b629aa99c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:06.318453 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-60386319-c00d-4b63-a1fe-49b629aa99c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1807 microversion: 2.20 time: 0.212969 Jun 16 19:00:06.319015 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 320/602] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:06 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:06.323113 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-94c3eb25-9fc9-43c7-bdbb-aeb7a89dcb27 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1675 microversion: 2.1 time: 0.215214 Jun 16 19:00:06.323673 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 283/603] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:06 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1675 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:06.435982 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3a08b059-1ca9-4eba-bd02-7ebdeb8c2ce5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:06.436650 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3a08b059-1ca9-4eba-bd02-7ebdeb8c2ce5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:06.442798 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3a08b059-1ca9-4eba-bd02-7ebdeb8c2ce5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.443259 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3a08b059-1ca9-4eba-bd02-7ebdeb8c2ce5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.444026 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3a08b059-1ca9-4eba-bd02-7ebdeb8c2ce5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.444467 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3a08b059-1ca9-4eba-bd02-7ebdeb8c2ce5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.458979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:06.475428 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3a08b059-1ca9-4eba-bd02-7ebdeb8c2ce5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.475880 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3a08b059-1ca9-4eba-bd02-7ebdeb8c2ce5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.476329 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-3a08b059-1ca9-4eba-bd02-7ebdeb8c2ce5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lazy-loading 'fault' on Instance uuid d500eb77-0c7f-432b-8afb-de6928841d70 {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:00:06.516691 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3a08b059-1ca9-4eba-bd02-7ebdeb8c2ce5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '325f963f409b4fd68f9ac9a29de4be72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e5a9406f7f4ccba4aaf2cccf1de07e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:06.524175 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3a08b059-1ca9-4eba-bd02-7ebdeb8c2ce5 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 200 len: 1303 microversion: 2.1 time: 0.092045 Jun 16 19:00:06.524732 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 321/604] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:06 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:06.872443 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-63d617cd-9ee4-4b93-88f0-7a1a1c82368d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:06.873222 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-63d617cd-9ee4-4b93-88f0-7a1a1c82368d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:06.879630 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-63d617cd-9ee4-4b93-88f0-7a1a1c82368d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.880079 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-63d617cd-9ee4-4b93-88f0-7a1a1c82368d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.880873 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-63d617cd-9ee4-4b93-88f0-7a1a1c82368d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.882587 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-63d617cd-9ee4-4b93-88f0-7a1a1c82368d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.022997 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-63d617cd-9ee4-4b93-88f0-7a1a1c82368d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:07.032151 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-63d617cd-9ee4-4b93-88f0-7a1a1c82368d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.163507 Jun 16 19:00:07.033011 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 284/605] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:06 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:07.337872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-49096438-f921-4d39-b634-e0399ec7427f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:07.338494 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-49096438-f921-4d39-b634-e0399ec7427f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:07.339994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-90145e4d-9934-41c6-8de4-398181275b2d tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:07.340641 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-90145e4d-9934-41c6-8de4-398181275b2d tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:07.344573 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-49096438-f921-4d39-b634-e0399ec7427f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:07.345029 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-49096438-f921-4d39-b634-e0399ec7427f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.345839 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-49096438-f921-4d39-b634-e0399ec7427f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:07.346279 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-49096438-f921-4d39-b634-e0399ec7427f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.346846 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-90145e4d-9934-41c6-8de4-398181275b2d tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:07.347307 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-90145e4d-9934-41c6-8de4-398181275b2d tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.348071 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-90145e4d-9934-41c6-8de4-398181275b2d tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:07.348562 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-90145e4d-9934-41c6-8de4-398181275b2d tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.541987 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-49096438-f921-4d39-b634-e0399ec7427f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:07.545901 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-90145e4d-9934-41c6-8de4-398181275b2d tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:07.550444 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-49096438-f921-4d39-b634-e0399ec7427f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:07.552460 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-49096438-f921-4d39-b634-e0399ec7427f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:07.553647 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-49096438-f921-4d39-b634-e0399ec7427f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1794 microversion: 2.20 time: 0.220637 Jun 16 19:00:07.554079 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-90145e4d-9934-41c6-8de4-398181275b2d tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1675 microversion: 2.1 time: 0.217973 Jun 16 19:00:07.554205 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 322/606] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:07 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1794 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:07.554637 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 285/607] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:07 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1675 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:07.558568 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-44a8e1c4-3bc4-4e99-b27a-40254f741143 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:07.559175 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-44a8e1c4-3bc4-4e99-b27a-40254f741143 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] [instance: d500eb77-0c7f-432b-8afb-de6928841d70] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:07.565078 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-44a8e1c4-3bc4-4e99-b27a-40254f741143 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:07.565561 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-44a8e1c4-3bc4-4e99-b27a-40254f741143 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.566338 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-44a8e1c4-3bc4-4e99-b27a-40254f741143 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:07.566778 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-44a8e1c4-3bc4-4e99-b27a-40254f741143 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.580536 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-44a8e1c4-3bc4-4e99-b27a-40254f741143 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] HTTP exception thrown: Instance d500eb77-0c7f-432b-8afb-de6928841d70 could not be found. Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-44a8e1c4-3bc4-4e99-b27a-40254f741143 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Request method failure captured: Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 HTTP/1.1 Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq31kfYdc_hbFwFel4ef8yjT63m9c-A_tz5XVfYZkwHhK7d7Eob9lekn2FgFKKR_QubY_73uqkv_r5vg6zhZGjQmRKT_QXQ5ScS1RsZGnzk8kMBCMhPmPQNtoH-4jHkfFFgXEtw5mbD_au_dnv_CRAUiyA_4pKNLJTC2mdpISXakoRsg Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: c5e5a9406f7f4ccba4aaf2cccf1de07e Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-VolumesActionsTest-1949743194 Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:00:07.582186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:00:07.583692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c5e5a9406f7f4ccba4aaf2cccf1de07e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_c5e5a9406f7f4ccba4aaf2cccf1de07e", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/c5e5a9406f7f4ccba4aaf2cccf1de07e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/c5e5a9406f7f4ccba4aaf2cccf1de07e"}]}] Jun 16 19:00:07.583692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-VolumesActionsTest-1949743194 Jun 16 19:00:07.583692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: c5e5a9406f7f4ccba4aaf2cccf1de07e Jun 16 19:00:07.583692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-VolumesActionsTest-1949743194 Jun 16 19:00:07.583692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-VolumesActionsTest-1949743194-project Jun 16 19:00:07.583692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:00:07.583692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:00:07.583692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 325f963f409b4fd68f9ac9a29de4be72 Jun 16 19:00:07.583692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-VolumesActionsTest-1949743194-project Jun 16 19:00:07.583692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:00:07.583692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance d500eb77-0c7f-432b-8afb-de6928841d70 could not be found. Jun 16 19:00:07.583692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': 'd500eb77-0c7f-432b-8afb-de6928841d70'} Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d500eb77-0c7f-432b-8afb-de6928841d70 could not be found. Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:00:07.584476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d500eb77-0c7f-432b-8afb-de6928841d70 could not be found. Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d500eb77-0c7f-432b-8afb-de6928841d70 could not be found. Jun 16 19:00:07.585659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:00:07.586718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-44a8e1c4-3bc4-4e99-b27a-40254f741143 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] Returning 404 to user: Instance d500eb77-0c7f-432b-8afb-de6928841d70 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:00:07.586718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-44a8e1c4-3bc4-4e99-b27a-40254f741143 tempest-VolumesActionsTest-1949743194 tempest-VolumesActionsTest-1949743194-project] 10.222.0.81 "GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70" status: 404 len: 111 microversion: 2.1 time: 0.028440 Jun 16 19:00:07.586718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 323/608] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:07 2022] GET /compute/v2.1/servers/d500eb77-0c7f-432b-8afb-de6928841d70 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:00:07.943629 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-970297183", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "networks": [{"uuid": "1cba00b2-5236-4b98-9847-76f93e5270f2"}]}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:07.998669 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.network.neutron [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] validate_networks() for [('1cba00b2-5236-4b98-9847-76f93e5270f2', None, None, None, None, None)] {{(pid=130230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:00:08.052811 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-64f9a4ef-9afa-446b-b916-415c5320ddc2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:08.053762 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-64f9a4ef-9afa-446b-b916-415c5320ddc2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:08.061413 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-64f9a4ef-9afa-446b-b916-415c5320ddc2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:08.061972 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-64f9a4ef-9afa-446b-b916-415c5320ddc2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:08.062845 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-64f9a4ef-9afa-446b-b916-415c5320ddc2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:08.063390 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-64f9a4ef-9afa-446b-b916-415c5320ddc2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:08.286670 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-64f9a4ef-9afa-446b-b916-415c5320ddc2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:08.296649 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-64f9a4ef-9afa-446b-b916-415c5320ddc2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.249770 Jun 16 19:00:08.297194 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 324/609] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:08 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:08.440830 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Flavor limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:00:08.441312 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Image limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:00:08.441793 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Flavor pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:00:08.442205 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Image pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:00:08.443192 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:00:08.452691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:08.453146 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:08.454016 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:08.454503 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:08.472129 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Getting quotas for project e16a74b1bc56455b8f60bfc28bc94afb. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:00:08.476147 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Getting quotas for user eed09fa6ecf14635949417f19c8a3af0 and project e16a74b1bc56455b8f60bfc28bc94afb. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:00:08.487487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Going to run 1 instances... {{(pid=130230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:00:08.490311 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:00:08.571473 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-05ca9c62-e0ae-485e-b2fd-fd91894fbb90 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:08.572084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-05ca9c62-e0ae-485e-b2fd-fd91894fbb90 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:08.578068 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-05ca9c62-e0ae-485e-b2fd-fd91894fbb90 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:08.578523 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-05ca9c62-e0ae-485e-b2fd-fd91894fbb90 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:08.579289 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-05ca9c62-e0ae-485e-b2fd-fd91894fbb90 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:08.579732 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-05ca9c62-e0ae-485e-b2fd-fd91894fbb90 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:08.626271 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1cf5849b-5a15-4766-9922-ef9de036961f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686410 Jun 16 19:00:08.626923 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 286/610] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 19:00:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:00:08.637233 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4236cc94-23b7-4a18-a544-714e66aa354f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:08.637886 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4236cc94-23b7-4a18-a544-714e66aa354f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:08.640919 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:08.710625 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4236cc94-23b7-4a18-a544-714e66aa354f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:08.719800 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4236cc94-23b7-4a18-a544-714e66aa354f tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1218 microversion: 2.1 time: 0.086235 Jun 16 19:00:08.729029 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 287/611] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:08 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:08.762731 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-05ca9c62-e0ae-485e-b2fd-fd91894fbb90 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:08.771661 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-05ca9c62-e0ae-485e-b2fd-fd91894fbb90 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1652 microversion: 2.1 time: 0.204695 Jun 16 19:00:08.772511 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 325/612] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:08 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1652 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:08.788043 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9145acef-a44f-4685-8014-4df8211d21e4 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:08.795152 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9145acef-a44f-4685-8014-4df8211d21e4 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:08.795601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9145acef-a44f-4685-8014-4df8211d21e4 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:08.820731 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9145acef-a44f-4685-8014-4df8211d21e4 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Going to try to start instance {{(pid=130230) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 19:00:08.971063 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9145acef-a44f-4685-8014-4df8211d21e4 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "POST /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/action" status: 202 len: 0 microversion: 2.1 time: 0.186761 Jun 16 19:00:08.971722 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 288/613] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jun 16 19:00:08 2022] POST /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:00:08.980268 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b4d30d17-37af-4729-8d52-ad6223bc6de7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:08.980968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b4d30d17-37af-4729-8d52-ad6223bc6de7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:08.987007 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b4d30d17-37af-4729-8d52-ad6223bc6de7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:08.987720 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b4d30d17-37af-4729-8d52-ad6223bc6de7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:08.988628 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b4d30d17-37af-4729-8d52-ad6223bc6de7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:08.989995 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b4d30d17-37af-4729-8d52-ad6223bc6de7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:09.151686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b4d30d17-37af-4729-8d52-ad6223bc6de7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:09.162694 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b4d30d17-37af-4729-8d52-ad6223bc6de7 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1661 microversion: 2.1 time: 0.186170 Jun 16 19:00:09.163267 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 326/614] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:08 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1661 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:09.320432 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6734dfa2-ce6f-4f4a-a58f-4c2a460cbc39 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:09.321163 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6734dfa2-ce6f-4f4a-a58f-4c2a460cbc39 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:09.327355 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6734dfa2-ce6f-4f4a-a58f-4c2a460cbc39 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:09.327801 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6734dfa2-ce6f-4f4a-a58f-4c2a460cbc39 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:09.328566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6734dfa2-ce6f-4f4a-a58f-4c2a460cbc39 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:09.329009 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6734dfa2-ce6f-4f4a-a58f-4c2a460cbc39 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:09.460585 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6734dfa2-ce6f-4f4a-a58f-4c2a460cbc39 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:09.468632 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6734dfa2-ce6f-4f4a-a58f-4c2a460cbc39 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.152907 Jun 16 19:00:09.469205 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 289/615] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:09 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:09.737154 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a1d15dde-bd16-448a-9350-16ad6c7c1698 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:09.738057 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a1d15dde-bd16-448a-9350-16ad6c7c1698 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:09.744165 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a1d15dde-bd16-448a-9350-16ad6c7c1698 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:09.744617 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a1d15dde-bd16-448a-9350-16ad6c7c1698 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:09.745420 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a1d15dde-bd16-448a-9350-16ad6c7c1698 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:09.745860 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a1d15dde-bd16-448a-9350-16ad6c7c1698 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:09.809617 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a1d15dde-bd16-448a-9350-16ad6c7c1698 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:09.816976 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a1d15dde-bd16-448a-9350-16ad6c7c1698 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1222 microversion: 2.1 time: 0.083693 Jun 16 19:00:09.818082 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 327/616] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:09 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:10.179881 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-43900c13-7609-4381-b075-1739f4d6cdac tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:10.180496 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-43900c13-7609-4381-b075-1739f4d6cdac tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:10.186993 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-43900c13-7609-4381-b075-1739f4d6cdac tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:10.187679 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-43900c13-7609-4381-b075-1739f4d6cdac tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:10.188460 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-43900c13-7609-4381-b075-1739f4d6cdac tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:10.188900 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-43900c13-7609-4381-b075-1739f4d6cdac tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:10.316314 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-43900c13-7609-4381-b075-1739f4d6cdac tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:10.324407 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-43900c13-7609-4381-b075-1739f4d6cdac tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1661 microversion: 2.1 time: 0.149004 Jun 16 19:00:10.324967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 290/617] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:10 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1661 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:10.495754 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-006a33ba-9aa2-40c7-90b0-a2ec50659ef9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:10.496399 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-006a33ba-9aa2-40c7-90b0-a2ec50659ef9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:10.502541 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-006a33ba-9aa2-40c7-90b0-a2ec50659ef9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:10.503035 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-006a33ba-9aa2-40c7-90b0-a2ec50659ef9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:10.503806 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-006a33ba-9aa2-40c7-90b0-a2ec50659ef9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:10.504248 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-006a33ba-9aa2-40c7-90b0-a2ec50659ef9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:10.631196 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-006a33ba-9aa2-40c7-90b0-a2ec50659ef9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:10.639105 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-006a33ba-9aa2-40c7-90b0-a2ec50659ef9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.147192 Jun 16 19:00:10.639663 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 328/618] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:10 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:10.834683 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-76571dc6-086b-42ad-a218-60c5c1722217 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:10.835212 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-76571dc6-086b-42ad-a218-60c5c1722217 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:10.841330 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-76571dc6-086b-42ad-a218-60c5c1722217 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:10.841772 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-76571dc6-086b-42ad-a218-60c5c1722217 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:10.842521 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-76571dc6-086b-42ad-a218-60c5c1722217 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:10.842949 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-76571dc6-086b-42ad-a218-60c5c1722217 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:10.901521 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-76571dc6-086b-42ad-a218-60c5c1722217 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:10.908677 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-76571dc6-086b-42ad-a218-60c5c1722217 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1222 microversion: 2.1 time: 0.078389 Jun 16 19:00:10.909232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 291/619] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:10 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:11.341630 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f8da5979-bdb8-4e99-96e8-292dc257038e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:11.342370 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f8da5979-bdb8-4e99-96e8-292dc257038e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:11.348431 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f8da5979-bdb8-4e99-96e8-292dc257038e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:11.348977 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f8da5979-bdb8-4e99-96e8-292dc257038e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:11.349778 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f8da5979-bdb8-4e99-96e8-292dc257038e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:11.350221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f8da5979-bdb8-4e99-96e8-292dc257038e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:11.483123 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f8da5979-bdb8-4e99-96e8-292dc257038e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:11.491372 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f8da5979-bdb8-4e99-96e8-292dc257038e tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1661 microversion: 2.1 time: 0.153692 Jun 16 19:00:11.492393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 329/620] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:11 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1661 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:11.656037 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a3e8853c-11c3-483d-bea1-969d53005dfb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:11.656578 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a3e8853c-11c3-483d-bea1-969d53005dfb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:11.663061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a3e8853c-11c3-483d-bea1-969d53005dfb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:11.663502 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a3e8853c-11c3-483d-bea1-969d53005dfb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:11.664259 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a3e8853c-11c3-483d-bea1-969d53005dfb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:11.664686 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a3e8853c-11c3-483d-bea1-969d53005dfb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:11.793732 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a3e8853c-11c3-483d-bea1-969d53005dfb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:11.802407 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a3e8853c-11c3-483d-bea1-969d53005dfb tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.149771 Jun 16 19:00:11.802969 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 292/621] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:11 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:11.925708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-659ba9fe-aa19-4968-adfa-99dcb0b6f144 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:11.926287 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-659ba9fe-aa19-4968-adfa-99dcb0b6f144 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:11.932961 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-659ba9fe-aa19-4968-adfa-99dcb0b6f144 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:11.933425 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-659ba9fe-aa19-4968-adfa-99dcb0b6f144 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:11.934192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-659ba9fe-aa19-4968-adfa-99dcb0b6f144 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:11.934660 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-659ba9fe-aa19-4968-adfa-99dcb0b6f144 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:12.004839 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-659ba9fe-aa19-4968-adfa-99dcb0b6f144 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:12.013030 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-659ba9fe-aa19-4968-adfa-99dcb0b6f144 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1222 microversion: 2.1 time: 0.091148 Jun 16 19:00:12.022304 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 330/622] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:11 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:12.508762 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ed5f9ee6-4847-4711-b80c-30e89295c90b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:12.509297 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ed5f9ee6-4847-4711-b80c-30e89295c90b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:12.515367 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ed5f9ee6-4847-4711-b80c-30e89295c90b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:12.515810 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ed5f9ee6-4847-4711-b80c-30e89295c90b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:12.516565 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ed5f9ee6-4847-4711-b80c-30e89295c90b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:12.517001 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ed5f9ee6-4847-4711-b80c-30e89295c90b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:12.643122 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ed5f9ee6-4847-4711-b80c-30e89295c90b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:12.651193 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ed5f9ee6-4847-4711-b80c-30e89295c90b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1661 microversion: 2.1 time: 0.146522 Jun 16 19:00:12.651753 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 293/623] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:12 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1661 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:12.820083 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-98e9ec9c-ceca-46d6-8d14-f502394edff3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:12.820810 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-98e9ec9c-ceca-46d6-8d14-f502394edff3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:12.827124 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-98e9ec9c-ceca-46d6-8d14-f502394edff3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:12.827595 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-98e9ec9c-ceca-46d6-8d14-f502394edff3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:12.828547 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-98e9ec9c-ceca-46d6-8d14-f502394edff3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:12.828986 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-98e9ec9c-ceca-46d6-8d14-f502394edff3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:12.962988 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-98e9ec9c-ceca-46d6-8d14-f502394edff3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:12.971153 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-98e9ec9c-ceca-46d6-8d14-f502394edff3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.155612 Jun 16 19:00:12.971930 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 331/624] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:12 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:13.029565 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6d9a5fe8-b466-4441-a3ae-a37457d45ed2 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:13.030174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6d9a5fe8-b466-4441-a3ae-a37457d45ed2 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:13.036908 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d9a5fe8-b466-4441-a3ae-a37457d45ed2 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:13.037386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d9a5fe8-b466-4441-a3ae-a37457d45ed2 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:13.038336 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d9a5fe8-b466-4441-a3ae-a37457d45ed2 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:13.038768 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d9a5fe8-b466-4441-a3ae-a37457d45ed2 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:13.101123 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6d9a5fe8-b466-4441-a3ae-a37457d45ed2 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:13.108492 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6d9a5fe8-b466-4441-a3ae-a37457d45ed2 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1278 microversion: 2.1 time: 0.082911 Jun 16 19:00:13.109046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 294/625] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:13 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1278 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:13.674221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f7a84abb-3cdb-464d-af49-415faabcaa85 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:13.674864 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f7a84abb-3cdb-464d-af49-415faabcaa85 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:13.684596 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f7a84abb-3cdb-464d-af49-415faabcaa85 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:13.685049 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f7a84abb-3cdb-464d-af49-415faabcaa85 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:13.685861 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f7a84abb-3cdb-464d-af49-415faabcaa85 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:13.686296 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f7a84abb-3cdb-464d-af49-415faabcaa85 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:13.914050 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f7a84abb-3cdb-464d-af49-415faabcaa85 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:13.924930 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f7a84abb-3cdb-464d-af49-415faabcaa85 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1665 microversion: 2.1 time: 0.259750 Jun 16 19:00:13.941968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 332/626] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:13 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1665 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:13.989979 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b7db3209-6c09-49e3-ab8b-56caf01f88e8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:13.991118 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b7db3209-6c09-49e3-ab8b-56caf01f88e8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:14.017511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b7db3209-6c09-49e3-ab8b-56caf01f88e8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:14.018336 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b7db3209-6c09-49e3-ab8b-56caf01f88e8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:14.019365 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b7db3209-6c09-49e3-ab8b-56caf01f88e8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:14.019991 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b7db3209-6c09-49e3-ab8b-56caf01f88e8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:14.038218 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:14.126971 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c1f58501-a5cf-4f48-9f8e-29eabfd914d4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:14.127844 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c1f58501-a5cf-4f48-9f8e-29eabfd914d4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:14.135724 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c1f58501-a5cf-4f48-9f8e-29eabfd914d4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:14.136467 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c1f58501-a5cf-4f48-9f8e-29eabfd914d4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:14.137492 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c1f58501-a5cf-4f48-9f8e-29eabfd914d4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:14.138144 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c1f58501-a5cf-4f48-9f8e-29eabfd914d4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:14.258126 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c1f58501-a5cf-4f48-9f8e-29eabfd914d4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:14.266275 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c1f58501-a5cf-4f48-9f8e-29eabfd914d4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1288 microversion: 2.1 time: 0.143173 Jun 16 19:00:14.267354 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 333/627] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:14 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1288 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:14.388908 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b7db3209-6c09-49e3-ab8b-56caf01f88e8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:14.397726 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b7db3209-6c09-49e3-ab8b-56caf01f88e8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.412921 Jun 16 19:00:14.398689 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 295/628] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:13 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:15.284334 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8108505b-984e-4585-b4f8-b5351b275179 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:15.284953 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8108505b-984e-4585-b4f8-b5351b275179 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:15.300920 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8108505b-984e-4585-b4f8-b5351b275179 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:15.301393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8108505b-984e-4585-b4f8-b5351b275179 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:15.302564 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8108505b-984e-4585-b4f8-b5351b275179 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:15.303736 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8108505b-984e-4585-b4f8-b5351b275179 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:15.416553 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c0842f7d-e643-43c6-9cb0-2a9a3c687142 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:15.418040 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-c0842f7d-e643-43c6-9cb0-2a9a3c687142 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:15.427169 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c0842f7d-e643-43c6-9cb0-2a9a3c687142 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:15.431320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c0842f7d-e643-43c6-9cb0-2a9a3c687142 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:15.432438 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c0842f7d-e643-43c6-9cb0-2a9a3c687142 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:15.433809 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c0842f7d-e643-43c6-9cb0-2a9a3c687142 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:15.701946 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8108505b-984e-4585-b4f8-b5351b275179 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:15.716634 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8108505b-984e-4585-b4f8-b5351b275179 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1318 microversion: 2.1 time: 0.434276 Jun 16 19:00:15.717523 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 334/629] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:15 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:15.777456 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c0842f7d-e643-43c6-9cb0-2a9a3c687142 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:15.785896 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-c0842f7d-e643-43c6-9cb0-2a9a3c687142 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.373625 Jun 16 19:00:15.786826 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 296/630] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:15 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:16.433772 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-53748501-4b62-4766-92f8-e484b45a3d81 req-6781fb35-75ab-4841-9c77-f24415b68c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d390f1-f370-40cd-bb8f-718895371ba3", "tag": "ab068e39-8b7f-4539-b0c1-6a81612e51fd"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:16.446188 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-53748501-4b62-4766-92f8-e484b45a3d81 req-6781fb35-75ab-4841-9c77-f24415b68c62 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:16.446755 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-53748501-4b62-4766-92f8-e484b45a3d81 req-6781fb35-75ab-4841-9c77-f24415b68c62 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:16.460868 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-53748501-4b62-4766-92f8-e484b45a3d81 req-6781fb35-75ab-4841-9c77-f24415b68c62 service nova] Creating event network-changed:ab068e39-8b7f-4539-b0c1-6a81612e51fd for instance 06d390f1-f370-40cd-bb8f-718895371ba3 on hv-cinder-84617 Jun 16 19:00:16.466224 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-53748501-4b62-4766-92f8-e484b45a3d81 req-6781fb35-75ab-4841-9c77-f24415b68c62 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037247 Jun 16 19:00:16.466927 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 335/631] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:00:16.734554 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-7bb59b33-965e-4fa1-a478-6cfb5e3dfb60 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:16.735264 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-7bb59b33-965e-4fa1-a478-6cfb5e3dfb60 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:16.743249 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7bb59b33-965e-4fa1-a478-6cfb5e3dfb60 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:16.744515 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7bb59b33-965e-4fa1-a478-6cfb5e3dfb60 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:16.745748 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7bb59b33-965e-4fa1-a478-6cfb5e3dfb60 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:16.746188 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7bb59b33-965e-4fa1-a478-6cfb5e3dfb60 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:16.805638 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d935e718-51e0-4d7a-8576-6d501480168d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:16.812172 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d935e718-51e0-4d7a-8576-6d501480168d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:16.817778 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d935e718-51e0-4d7a-8576-6d501480168d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:16.818438 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d935e718-51e0-4d7a-8576-6d501480168d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:16.820148 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d935e718-51e0-4d7a-8576-6d501480168d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:16.820584 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d935e718-51e0-4d7a-8576-6d501480168d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:17.006875 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-7bb59b33-965e-4fa1-a478-6cfb5e3dfb60 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:17.016501 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-7bb59b33-965e-4fa1-a478-6cfb5e3dfb60 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1318 microversion: 2.1 time: 0.285695 Jun 16 19:00:17.022395 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 297/632] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:16 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:17.048598 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d935e718-51e0-4d7a-8576-6d501480168d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:17.057550 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d935e718-51e0-4d7a-8576-6d501480168d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.256799 Jun 16 19:00:17.067778 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 336/633] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:16 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:18.040674 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6e55ad2f-19fc-4196-bd31-5382259323fd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:18.042200 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6e55ad2f-19fc-4196-bd31-5382259323fd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:18.048948 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6e55ad2f-19fc-4196-bd31-5382259323fd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:18.049523 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6e55ad2f-19fc-4196-bd31-5382259323fd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:18.053953 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6e55ad2f-19fc-4196-bd31-5382259323fd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:18.053953 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6e55ad2f-19fc-4196-bd31-5382259323fd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:18.075458 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d9d21823-c0a2-4cf8-baad-f3e519360627 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:18.076089 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d9d21823-c0a2-4cf8-baad-f3e519360627 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:18.094392 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d9d21823-c0a2-4cf8-baad-f3e519360627 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:18.094848 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d9d21823-c0a2-4cf8-baad-f3e519360627 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:18.095633 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d9d21823-c0a2-4cf8-baad-f3e519360627 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:18.096067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d9d21823-c0a2-4cf8-baad-f3e519360627 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:18.306917 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6e55ad2f-19fc-4196-bd31-5382259323fd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:18.312250 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d9d21823-c0a2-4cf8-baad-f3e519360627 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:18.322870 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d9d21823-c0a2-4cf8-baad-f3e519360627 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.251452 Jun 16 19:00:18.323522 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 337/634] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:18 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:18.327758 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6e55ad2f-19fc-4196-bd31-5382259323fd tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1318 microversion: 2.1 time: 0.291114 Jun 16 19:00:18.338206 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 298/635] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:18 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:19.340921 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5bc53049-5a6e-4e02-9af7-4fe40d7c7c8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:19.346336 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d7b7dc95-1ee1-407a-b6d0-e5b38e950bf6 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:19.347612 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d7b7dc95-1ee1-407a-b6d0-e5b38e950bf6 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:19.349525 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5bc53049-5a6e-4e02-9af7-4fe40d7c7c8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:19.351756 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:19.352683 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=8 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:19.356884 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5bc53049-5a6e-4e02-9af7-4fe40d7c7c8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:19.357085 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d7b7dc95-1ee1-407a-b6d0-e5b38e950bf6 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:19.357389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5bc53049-5a6e-4e02-9af7-4fe40d7c7c8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:19.357600 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d7b7dc95-1ee1-407a-b6d0-e5b38e950bf6 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:19.358558 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d7b7dc95-1ee1-407a-b6d0-e5b38e950bf6 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:19.358768 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5bc53049-5a6e-4e02-9af7-4fe40d7c7c8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:19.359278 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5bc53049-5a6e-4e02-9af7-4fe40d7c7c8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:19.359770 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d7b7dc95-1ee1-407a-b6d0-e5b38e950bf6 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:19.642232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d7b7dc95-1ee1-407a-b6d0-e5b38e950bf6 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:19.654990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5bc53049-5a6e-4e02-9af7-4fe40d7c7c8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:19.655146 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d7b7dc95-1ee1-407a-b6d0-e5b38e950bf6 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1318 microversion: 2.1 time: 0.309744 Jun 16 19:00:19.655686 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 299/636] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:19 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:19.663331 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5bc53049-5a6e-4e02-9af7-4fe40d7c7c8d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.326579 Jun 16 19:00:19.663912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 338/637] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:19 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:20.672011 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-8c34b8fb-a17d-4352-a6f9-ba5e39751eda tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:20.673303 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-8c34b8fb-a17d-4352-a6f9-ba5e39751eda tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:20.681176 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8c34b8fb-a17d-4352-a6f9-ba5e39751eda tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:20.681974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8c34b8fb-a17d-4352-a6f9-ba5e39751eda tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:20.682763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8c34b8fb-a17d-4352-a6f9-ba5e39751eda tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:20.683207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8c34b8fb-a17d-4352-a6f9-ba5e39751eda tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:20.683628 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b35c8657-9d60-400c-89df-cb502ab1431a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:20.684524 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b35c8657-9d60-400c-89df-cb502ab1431a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:20.696776 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b35c8657-9d60-400c-89df-cb502ab1431a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:20.697752 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b35c8657-9d60-400c-89df-cb502ab1431a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:20.699420 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b35c8657-9d60-400c-89df-cb502ab1431a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:20.700578 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b35c8657-9d60-400c-89df-cb502ab1431a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:20.707786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=100 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:20.908002 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8c34b8fb-a17d-4352-a6f9-ba5e39751eda tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:20.916290 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-8c34b8fb-a17d-4352-a6f9-ba5e39751eda tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1318 microversion: 2.1 time: 0.248193 Jun 16 19:00:20.916868 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 300/638] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:20 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:20.921184 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b35c8657-9d60-400c-89df-cb502ab1431a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:20.935925 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b35c8657-9d60-400c-89df-cb502ab1431a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.259165 Jun 16 19:00:20.941305 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 339/639] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:20 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:21.934045 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-fe6f7c4b-217b-4ee0-a287-2817c5f46403 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:21.934755 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-fe6f7c4b-217b-4ee0-a287-2817c5f46403 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:21.941395 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fe6f7c4b-217b-4ee0-a287-2817c5f46403 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:21.942112 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fe6f7c4b-217b-4ee0-a287-2817c5f46403 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:21.943171 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fe6f7c4b-217b-4ee0-a287-2817c5f46403 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:21.943900 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fe6f7c4b-217b-4ee0-a287-2817c5f46403 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:21.954997 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7a28ebb4-b7e3-4cc8-8a07-cf3c733633d7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:21.956449 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7a28ebb4-b7e3-4cc8-8a07-cf3c733633d7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:21.968732 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7a28ebb4-b7e3-4cc8-8a07-cf3c733633d7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:21.969278 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7a28ebb4-b7e3-4cc8-8a07-cf3c733633d7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:21.970369 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7a28ebb4-b7e3-4cc8-8a07-cf3c733633d7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:21.976647 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7a28ebb4-b7e3-4cc8-8a07-cf3c733633d7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:22.324909 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-fe6f7c4b-217b-4ee0-a287-2817c5f46403 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:22.333201 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-fe6f7c4b-217b-4ee0-a287-2817c5f46403 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1318 microversion: 2.1 time: 0.403335 Jun 16 19:00:22.338091 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 301/640] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:21 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:22.341662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7a28ebb4-b7e3-4cc8-8a07-cf3c733633d7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:22.365535 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7a28ebb4-b7e3-4cc8-8a07-cf3c733633d7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.407691 Jun 16 19:00:22.376568 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-ee2b6c85-40ee-43d1-9e18-e9d35468c29c req-37e38988-8a8b-47ed-b3d2-107ab8f401e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d390f1-f370-40cd-bb8f-718895371ba3", "name": "network-vif-plugged", "status": "completed", "tag": "ab068e39-8b7f-4539-b0c1-6a81612e51fd"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:22.376688 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 340/641] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:21 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:22.378018 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-ee2b6c85-40ee-43d1-9e18-e9d35468c29c req-37e38988-8a8b-47ed-b3d2-107ab8f401e3 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:22.378672 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-ee2b6c85-40ee-43d1-9e18-e9d35468c29c req-37e38988-8a8b-47ed-b3d2-107ab8f401e3 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:22.391166 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-ee2b6c85-40ee-43d1-9e18-e9d35468c29c req-37e38988-8a8b-47ed-b3d2-107ab8f401e3 service nova] Creating event network-vif-plugged:ab068e39-8b7f-4539-b0c1-6a81612e51fd for instance 06d390f1-f370-40cd-bb8f-718895371ba3 on hv-cinder-84617 Jun 16 19:00:22.396358 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-ee2b6c85-40ee-43d1-9e18-e9d35468c29c req-37e38988-8a8b-47ed-b3d2-107ab8f401e3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044099 Jun 16 19:00:22.397024 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 302/642] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:00:23.357207 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e3c04c2c-db89-4687-b7a4-6e20e8bb4680 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:23.358426 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e3c04c2c-db89-4687-b7a4-6e20e8bb4680 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:23.369267 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e3c04c2c-db89-4687-b7a4-6e20e8bb4680 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:23.369724 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e3c04c2c-db89-4687-b7a4-6e20e8bb4680 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:23.370817 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e3c04c2c-db89-4687-b7a4-6e20e8bb4680 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:23.371132 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e3c04c2c-db89-4687-b7a4-6e20e8bb4680 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:23.390847 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6d418323-f872-4fd5-939b-3fedd1dd058b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:23.391694 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6d418323-f872-4fd5-939b-3fedd1dd058b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:23.410353 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d418323-f872-4fd5-939b-3fedd1dd058b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:23.414757 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d418323-f872-4fd5-939b-3fedd1dd058b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:23.415788 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d418323-f872-4fd5-939b-3fedd1dd058b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:23.416408 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d418323-f872-4fd5-939b-3fedd1dd058b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:23.635438 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e3c04c2c-db89-4687-b7a4-6e20e8bb4680 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:23.644466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e3c04c2c-db89-4687-b7a4-6e20e8bb4680 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1318 microversion: 2.1 time: 0.294038 Jun 16 19:00:23.655579 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 341/643] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:23 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:23.662081 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6d418323-f872-4fd5-939b-3fedd1dd058b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:23.671800 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6d418323-f872-4fd5-939b-3fedd1dd058b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.287343 Jun 16 19:00:23.672846 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 303/644] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:23 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:24.662329 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-62e721a5-8d01-4679-98c4-dbbbfa407733 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:24.663409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-62e721a5-8d01-4679-98c4-dbbbfa407733 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:24.671146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-62e721a5-8d01-4679-98c4-dbbbfa407733 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:24.671730 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-62e721a5-8d01-4679-98c4-dbbbfa407733 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:24.672623 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-62e721a5-8d01-4679-98c4-dbbbfa407733 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:24.673171 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-62e721a5-8d01-4679-98c4-dbbbfa407733 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:24.696964 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f6ee1799-4c04-4450-a03f-4a949b4262f4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:24.698198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f6ee1799-4c04-4450-a03f-4a949b4262f4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:24.705131 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f6ee1799-4c04-4450-a03f-4a949b4262f4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:24.706689 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f6ee1799-4c04-4450-a03f-4a949b4262f4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:24.707668 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f6ee1799-4c04-4450-a03f-4a949b4262f4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:24.708107 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f6ee1799-4c04-4450-a03f-4a949b4262f4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:24.945671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-62e721a5-8d01-4679-98c4-dbbbfa407733 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:24.950368 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f6ee1799-4c04-4450-a03f-4a949b4262f4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:24.955620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-62e721a5-8d01-4679-98c4-dbbbfa407733 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1508 microversion: 2.1 time: 0.297282 Jun 16 19:00:24.956393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 342/645] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:24 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1508 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:24.962965 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f6ee1799-4c04-4450-a03f-4a949b4262f4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.270906 Jun 16 19:00:24.973933 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 304/646] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:24 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:24.985320 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-21112e6a-e5ea-4e3f-8224-59ca6123b0de tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96cc73ec-7383-4850-aa09-15d7ec0a9551", "device": "/dev/sdb"}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:24.987098 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-21112e6a-e5ea-4e3f-8224-59ca6123b0de tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:25.004410 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-21112e6a-e5ea-4e3f-8224-59ca6123b0de tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:25.005484 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-21112e6a-e5ea-4e3f-8224-59ca6123b0de tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:25.007069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-21112e6a-e5ea-4e3f-8224-59ca6123b0de tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:25.007546 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-21112e6a-e5ea-4e3f-8224-59ca6123b0de tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:25.745418 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-21112e6a-e5ea-4e3f-8224-59ca6123b0de tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "POST /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.774310 Jun 16 19:00:25.746101 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 343/647] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jun 16 19:00:24 2022] POST /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3/os-volume_attachments => generated 194 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:00:26.038865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-20076f9a-43db-470f-bb09-c2972d70cb78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:26.038865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-20076f9a-43db-470f-bb09-c2972d70cb78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:26.038865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-20076f9a-43db-470f-bb09-c2972d70cb78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:26.038865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-20076f9a-43db-470f-bb09-c2972d70cb78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:26.040429 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-20076f9a-43db-470f-bb09-c2972d70cb78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:26.040429 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-20076f9a-43db-470f-bb09-c2972d70cb78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:26.139345 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-20076f9a-43db-470f-bb09-c2972d70cb78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:26.147360 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-20076f9a-43db-470f-bb09-c2972d70cb78 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.171292 Jun 16 19:00:26.147925 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 305/648] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:25 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:27.164780 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5031a6fb-100d-4143-bffb-5820d728c669 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:27.165657 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5031a6fb-100d-4143-bffb-5820d728c669 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:27.173986 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5031a6fb-100d-4143-bffb-5820d728c669 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:27.174523 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5031a6fb-100d-4143-bffb-5820d728c669 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:27.175363 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5031a6fb-100d-4143-bffb-5820d728c669 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:27.176054 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5031a6fb-100d-4143-bffb-5820d728c669 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:27.320154 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5031a6fb-100d-4143-bffb-5820d728c669 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:27.328638 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5031a6fb-100d-4143-bffb-5820d728c669 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.168339 Jun 16 19:00:27.338614 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 344/649] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:27 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:28.346499 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c6452867-4228-4b65-9d65-3eb4c9bc0773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:28.347788 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-c6452867-4228-4b65-9d65-3eb4c9bc0773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:28.355847 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c6452867-4228-4b65-9d65-3eb4c9bc0773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:28.356428 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c6452867-4228-4b65-9d65-3eb4c9bc0773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:28.357345 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c6452867-4228-4b65-9d65-3eb4c9bc0773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:28.358028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c6452867-4228-4b65-9d65-3eb4c9bc0773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:28.526546 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c6452867-4228-4b65-9d65-3eb4c9bc0773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:28.535166 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-c6452867-4228-4b65-9d65-3eb4c9bc0773 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.192882 Jun 16 19:00:28.544915 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 306/650] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:28 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:29.552654 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c525ca3f-8c10-40a9-b6a0-27d40b8b528f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:29.553459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c525ca3f-8c10-40a9-b6a0-27d40b8b528f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:29.561196 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c525ca3f-8c10-40a9-b6a0-27d40b8b528f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:29.561775 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c525ca3f-8c10-40a9-b6a0-27d40b8b528f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:29.562839 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c525ca3f-8c10-40a9-b6a0-27d40b8b528f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:29.563591 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c525ca3f-8c10-40a9-b6a0-27d40b8b528f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:29.713967 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c525ca3f-8c10-40a9-b6a0-27d40b8b528f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:29.723041 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c525ca3f-8c10-40a9-b6a0-27d40b8b528f tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.174752 Jun 16 19:00:29.733228 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 345/651] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:29 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:30.740156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3663862a-d194-4635-a85e-23b9ec120ec3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:30.740749 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3663862a-d194-4635-a85e-23b9ec120ec3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:30.747355 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3663862a-d194-4635-a85e-23b9ec120ec3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:30.747833 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3663862a-d194-4635-a85e-23b9ec120ec3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:30.748604 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3663862a-d194-4635-a85e-23b9ec120ec3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:30.749045 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3663862a-d194-4635-a85e-23b9ec120ec3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:30.875867 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-3663862a-d194-4635-a85e-23b9ec120ec3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:30.884276 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3663862a-d194-4635-a85e-23b9ec120ec3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.148334 Jun 16 19:00:30.884839 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 307/652] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:30 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:31.900703 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-87cce813-9f4d-429a-88d3-757f7c46ddf8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:31.901351 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-87cce813-9f4d-429a-88d3-757f7c46ddf8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:31.903820 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=78 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:31.908537 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-87cce813-9f4d-429a-88d3-757f7c46ddf8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:31.912485 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-87cce813-9f4d-429a-88d3-757f7c46ddf8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:31.912485 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-87cce813-9f4d-429a-88d3-757f7c46ddf8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:31.912485 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-87cce813-9f4d-429a-88d3-757f7c46ddf8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:32.041574 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-87cce813-9f4d-429a-88d3-757f7c46ddf8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:32.049635 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-87cce813-9f4d-429a-88d3-757f7c46ddf8 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.152797 Jun 16 19:00:32.050191 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 346/653] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:31 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:33.067535 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6f3ab213-d7e3-4155-b7fc-0aab10624d7e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:33.068157 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6f3ab213-d7e3-4155-b7fc-0aab10624d7e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:33.074653 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6f3ab213-d7e3-4155-b7fc-0aab10624d7e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:33.075106 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6f3ab213-d7e3-4155-b7fc-0aab10624d7e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:33.075873 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6f3ab213-d7e3-4155-b7fc-0aab10624d7e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:33.076315 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6f3ab213-d7e3-4155-b7fc-0aab10624d7e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:33.207067 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6f3ab213-d7e3-4155-b7fc-0aab10624d7e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:33.215546 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6f3ab213-d7e3-4155-b7fc-0aab10624d7e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.151964 Jun 16 19:00:33.216101 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 308/654] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:33 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:34.232082 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-31651978-6980-494c-91bc-e65ec34c6d24 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:34.232671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-31651978-6980-494c-91bc-e65ec34c6d24 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:34.239901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-31651978-6980-494c-91bc-e65ec34c6d24 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:34.240347 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-31651978-6980-494c-91bc-e65ec34c6d24 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:34.241124 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-31651978-6980-494c-91bc-e65ec34c6d24 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:34.242101 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-31651978-6980-494c-91bc-e65ec34c6d24 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:34.404148 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-31651978-6980-494c-91bc-e65ec34c6d24 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:34.412196 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-31651978-6980-494c-91bc-e65ec34c6d24 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.184114 Jun 16 19:00:34.412765 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 347/655] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:34 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:35.430341 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-66945f3f-6cf0-4bd7-81d2-86f99fcf6dc3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:35.431140 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-66945f3f-6cf0-4bd7-81d2-86f99fcf6dc3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:35.437583 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-66945f3f-6cf0-4bd7-81d2-86f99fcf6dc3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:35.438098 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-66945f3f-6cf0-4bd7-81d2-86f99fcf6dc3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:35.438943 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-66945f3f-6cf0-4bd7-81d2-86f99fcf6dc3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:35.439423 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-66945f3f-6cf0-4bd7-81d2-86f99fcf6dc3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:35.568851 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-66945f3f-6cf0-4bd7-81d2-86f99fcf6dc3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:35.582559 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-66945f3f-6cf0-4bd7-81d2-86f99fcf6dc3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.156419 Jun 16 19:00:35.583063 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 309/656] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:35 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:36.599743 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0c3798fc-63dd-4edd-a479-dc26670547c1 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:36.600381 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0c3798fc-63dd-4edd-a479-dc26670547c1 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:36.606768 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0c3798fc-63dd-4edd-a479-dc26670547c1 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:36.607227 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0c3798fc-63dd-4edd-a479-dc26670547c1 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:36.608000 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0c3798fc-63dd-4edd-a479-dc26670547c1 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:36.608469 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0c3798fc-63dd-4edd-a479-dc26670547c1 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:36.740924 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0c3798fc-63dd-4edd-a479-dc26670547c1 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:36.748893 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0c3798fc-63dd-4edd-a479-dc26670547c1 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.152962 Jun 16 19:00:36.749480 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 348/657] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:36 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:37.767018 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1ad44ef3-d95d-4a04-8dc3-865420370093 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:37.767636 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1ad44ef3-d95d-4a04-8dc3-865420370093 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:37.774665 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1ad44ef3-d95d-4a04-8dc3-865420370093 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:37.775118 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1ad44ef3-d95d-4a04-8dc3-865420370093 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:37.775891 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1ad44ef3-d95d-4a04-8dc3-865420370093 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:37.776331 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1ad44ef3-d95d-4a04-8dc3-865420370093 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:37.915547 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1ad44ef3-d95d-4a04-8dc3-865420370093 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:37.923378 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1ad44ef3-d95d-4a04-8dc3-865420370093 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.160205 Jun 16 19:00:37.923981 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 310/658] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:37 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:38.940418 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8b77f096-d86d-4d32-8e89-50c5b1ba8447 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:38.941025 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8b77f096-d86d-4d32-8e89-50c5b1ba8447 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:38.949290 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8b77f096-d86d-4d32-8e89-50c5b1ba8447 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:38.949744 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8b77f096-d86d-4d32-8e89-50c5b1ba8447 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:38.950520 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8b77f096-d86d-4d32-8e89-50c5b1ba8447 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:38.950961 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8b77f096-d86d-4d32-8e89-50c5b1ba8447 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:39.093863 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8b77f096-d86d-4d32-8e89-50c5b1ba8447 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:39.102570 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8b77f096-d86d-4d32-8e89-50c5b1ba8447 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.166497 Jun 16 19:00:39.103131 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 349/659] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:38 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:40.120622 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6cd895ff-0a1a-46db-9563-1a6af56c2b1a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:40.121262 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6cd895ff-0a1a-46db-9563-1a6af56c2b1a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:40.123644 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=49 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:40.128278 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6cd895ff-0a1a-46db-9563-1a6af56c2b1a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:40.132865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6cd895ff-0a1a-46db-9563-1a6af56c2b1a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:40.132865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6cd895ff-0a1a-46db-9563-1a6af56c2b1a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:40.132865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6cd895ff-0a1a-46db-9563-1a6af56c2b1a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:40.259040 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6cd895ff-0a1a-46db-9563-1a6af56c2b1a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:40.266907 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6cd895ff-0a1a-46db-9563-1a6af56c2b1a tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.150688 Jun 16 19:00:40.267475 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 311/660] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:40 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:41.283658 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e8cc22ed-d40b-43e0-b8a0-5f0f6837a3e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:41.284265 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e8cc22ed-d40b-43e0-b8a0-5f0f6837a3e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:41.290797 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e8cc22ed-d40b-43e0-b8a0-5f0f6837a3e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:41.291239 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e8cc22ed-d40b-43e0-b8a0-5f0f6837a3e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:41.291994 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e8cc22ed-d40b-43e0-b8a0-5f0f6837a3e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:41.292425 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e8cc22ed-d40b-43e0-b8a0-5f0f6837a3e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:41.422349 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e8cc22ed-d40b-43e0-b8a0-5f0f6837a3e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:41.430128 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e8cc22ed-d40b-43e0-b8a0-5f0f6837a3e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.150215 Jun 16 19:00:41.430683 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 350/661] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:41 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:42.447314 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1cf82091-734f-4890-a4d6-2f368c8ba414 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:42.447905 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1cf82091-734f-4890-a4d6-2f368c8ba414 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:42.454481 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cf82091-734f-4890-a4d6-2f368c8ba414 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:42.454934 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cf82091-734f-4890-a4d6-2f368c8ba414 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:42.455699 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cf82091-734f-4890-a4d6-2f368c8ba414 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:42.456140 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cf82091-734f-4890-a4d6-2f368c8ba414 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:42.593147 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1cf82091-734f-4890-a4d6-2f368c8ba414 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:42.595393 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=100 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:42.605443 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1cf82091-734f-4890-a4d6-2f368c8ba414 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1733 microversion: 2.1 time: 0.162023 Jun 16 19:00:42.606007 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 312/662] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:42 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:43.623444 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-08639eb2-4287-44ea-8e02-d75049751e02 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:43.623444 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-08639eb2-4287-44ea-8e02-d75049751e02 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:43.629868 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08639eb2-4287-44ea-8e02-d75049751e02 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:43.630499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08639eb2-4287-44ea-8e02-d75049751e02 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:43.631490 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08639eb2-4287-44ea-8e02-d75049751e02 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:43.631926 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08639eb2-4287-44ea-8e02-d75049751e02 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:43.768955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-08639eb2-4287-44ea-8e02-d75049751e02 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:43.777444 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-08639eb2-4287-44ea-8e02-d75049751e02 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1713 microversion: 2.1 time: 0.159043 Jun 16 19:00:43.777995 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 351/663] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:43 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1713 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:43.880430 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-18fe0821-7c61-41fa-bb24-4f0d4d7fae16 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:43.881033 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-18fe0821-7c61-41fa-bb24-4f0d4d7fae16 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:43.887957 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-18fe0821-7c61-41fa-bb24-4f0d4d7fae16 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:43.888404 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-18fe0821-7c61-41fa-bb24-4f0d4d7fae16 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:43.897366 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-18fe0821-7c61-41fa-bb24-4f0d4d7fae16 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:43.897366 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-18fe0821-7c61-41fa-bb24-4f0d4d7fae16 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:44.016945 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-18fe0821-7c61-41fa-bb24-4f0d4d7fae16 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] HTTP exception thrown: Cannot 'detach_volume' instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d while it is in vm_state rescued Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-18fe0821-7c61-41fa-bb24-4f0d4d7fae16 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Request method failure captured: Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: DELETE /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-volume_attachments/40b69ccd-6cbe-4c7d-aab0-a69290a51494 HTTP/1.1 Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq3zGXPpz6QpTlYMAzUwZA2FxpZlcsMj2PZk5Me98X004ESO6iHhtyZi01S2HrA7QRavaFYn_gvj72vUb3j1o8y1FEQDlH2mCzxj0otKQa2G_t9ABiX9PFlgtXlKad4vu-Z7kFV6K2VyP4Foc5kZ5IbGmbuR92aI1zzs_J7gOZWCDPP0 Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: ed8501d1ff734054ba0a6ef4c398d051 Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1664066176 Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:00:44.018589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:00:44.020059 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ed8501d1ff734054ba0a6ef4c398d051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ed8501d1ff734054ba0a6ef4c398d051", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ed8501d1ff734054ba0a6ef4c398d051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ed8501d1ff734054ba0a6ef4c398d051"}]}] Jun 16 19:00:44.020059 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1664066176 Jun 16 19:00:44.020059 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: ed8501d1ff734054ba0a6ef4c398d051 Jun 16 19:00:44.020059 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1664066176 Jun 16 19:00:44.020059 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-ServerRescueNegativeTestJSON-1664066176-project Jun 16 19:00:44.020059 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:00:44.020059 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:00:44.020059 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 7310c631282c495a83e17dbdbc6d2ba0 Jun 16 19:00:44.020059 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1664066176-project Jun 16 19:00:44.020059 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:00:44.020059 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Cannot 'detach_volume' instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d while it is in vm_state rescued Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'server_id': '88123824-1b55-41ca-a29f-0d3e0edd3d1d', 'id': '40b69ccd-6cbe-4c7d-aab0-a69290a51494'} Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:00:44.020820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d while it is in vm_state rescued Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d while it is in vm_state rescued Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:00:44.022437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-18fe0821-7c61-41fa-bb24-4f0d4d7fae16 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Returning 409 to user: Cannot 'detach_volume' instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d while it is in vm_state rescued {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:00:44.024780 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-18fe0821-7c61-41fa-bb24-4f0d4d7fae16 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "DELETE /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-volume_attachments/40b69ccd-6cbe-4c7d-aab0-a69290a51494" status: 409 len: 152 microversion: 2.1 time: 0.143638 Jun 16 19:00:44.024780 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 313/664] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jun 16 19:00:43 2022] DELETE /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-volume_attachments/40b69ccd-6cbe-4c7d-aab0-a69290a51494 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 19:00:44.029857 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-236f9108-9e51-4d82-9e88-9d4e3004b21d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:44.030399 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-236f9108-9e51-4d82-9e88-9d4e3004b21d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:44.037076 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-236f9108-9e51-4d82-9e88-9d4e3004b21d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:44.037577 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-236f9108-9e51-4d82-9e88-9d4e3004b21d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:44.038376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-236f9108-9e51-4d82-9e88-9d4e3004b21d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:44.039452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-236f9108-9e51-4d82-9e88-9d4e3004b21d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:44.264514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-236f9108-9e51-4d82-9e88-9d4e3004b21d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "POST /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/action" status: 202 len: 0 microversion: 2.1 time: 0.238480 Jun 16 19:00:44.266678 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 352/665] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jun 16 19:00:44 2022] POST /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:00:44.274227 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-99aa23e9-8e20-4a03-9d9a-3fc06cb8cd05 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:44.275235 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-99aa23e9-8e20-4a03-9d9a-3fc06cb8cd05 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:44.282488 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-99aa23e9-8e20-4a03-9d9a-3fc06cb8cd05 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:44.287670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-99aa23e9-8e20-4a03-9d9a-3fc06cb8cd05 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:44.287670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-99aa23e9-8e20-4a03-9d9a-3fc06cb8cd05 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:44.287670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-99aa23e9-8e20-4a03-9d9a-3fc06cb8cd05 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:44.526994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-99aa23e9-8e20-4a03-9d9a-3fc06cb8cd05 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:44.536134 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-99aa23e9-8e20-4a03-9d9a-3fc06cb8cd05 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1721 microversion: 2.1 time: 0.266561 Jun 16 19:00:44.539264 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 314/666] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:44 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:45.555628 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e56d3c79-4738-458d-8ff2-1ddc88b35bf5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:45.556330 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e56d3c79-4738-458d-8ff2-1ddc88b35bf5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:45.563027 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e56d3c79-4738-458d-8ff2-1ddc88b35bf5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:45.563476 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e56d3c79-4738-458d-8ff2-1ddc88b35bf5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:45.564238 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e56d3c79-4738-458d-8ff2-1ddc88b35bf5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:45.564671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e56d3c79-4738-458d-8ff2-1ddc88b35bf5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:45.580587 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:45.701185 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e56d3c79-4738-458d-8ff2-1ddc88b35bf5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:45.709737 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e56d3c79-4738-458d-8ff2-1ddc88b35bf5 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1721 microversion: 2.1 time: 0.158723 Jun 16 19:00:45.710296 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 353/667] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:45 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:46.732235 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-dd3aa328-3efb-43be-9289-824e522607ea tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:46.732743 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-dd3aa328-3efb-43be-9289-824e522607ea tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:46.739243 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-dd3aa328-3efb-43be-9289-824e522607ea tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:46.739699 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-dd3aa328-3efb-43be-9289-824e522607ea tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:46.740768 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-dd3aa328-3efb-43be-9289-824e522607ea tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:46.741210 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-dd3aa328-3efb-43be-9289-824e522607ea tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:46.742780 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3c273444-d481-4897-add6-c4b6ca97ec7b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:46.743403 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3c273444-d481-4897-add6-c4b6ca97ec7b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:46.750315 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3c273444-d481-4897-add6-c4b6ca97ec7b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:46.750773 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3c273444-d481-4897-add6-c4b6ca97ec7b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:46.751707 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3c273444-d481-4897-add6-c4b6ca97ec7b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:46.752093 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3c273444-d481-4897-add6-c4b6ca97ec7b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:46.824823 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.objects.instance [None req-dd3aa328-3efb-43be-9289-824e522607ea tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lazy-loading 'services' on Instance uuid 06d390f1-f370-40cd-bb8f-718895371ba3 {{(pid=130230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:00:46.886128 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3c273444-d481-4897-add6-c4b6ca97ec7b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:46.894068 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3c273444-d481-4897-add6-c4b6ca97ec7b tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1721 microversion: 2.1 time: 0.155896 Jun 16 19:00:46.894910 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 354/668] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:46 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:47.048370 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-dd3aa328-3efb-43be-9289-824e522607ea tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "DELETE /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3/os-volume_attachments/96cc73ec-7383-4850-aa09-15d7ec0a9551" status: 202 len: 0 microversion: 2.1 time: 0.320008 Jun 16 19:00:47.048957 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 315/669] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jun 16 19:00:46 2022] DELETE /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3/os-volume_attachments/96cc73ec-7383-4850-aa09-15d7ec0a9551 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:00:47.911659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-423523f1-7ab8-4e89-87ab-0dbc71db61fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:47.912317 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-423523f1-7ab8-4e89-87ab-0dbc71db61fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:47.918869 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-423523f1-7ab8-4e89-87ab-0dbc71db61fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:47.919368 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-423523f1-7ab8-4e89-87ab-0dbc71db61fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:47.920150 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-423523f1-7ab8-4e89-87ab-0dbc71db61fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:47.920585 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-423523f1-7ab8-4e89-87ab-0dbc71db61fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:48.050026 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-423523f1-7ab8-4e89-87ab-0dbc71db61fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:48.057846 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-423523f1-7ab8-4e89-87ab-0dbc71db61fe tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1721 microversion: 2.1 time: 0.150390 Jun 16 19:00:48.058406 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 355/670] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:47 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:49.076810 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-cdb78c35-a4a3-47e0-8716-738898504f72 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:49.077621 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-cdb78c35-a4a3-47e0-8716-738898504f72 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:49.084011 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cdb78c35-a4a3-47e0-8716-738898504f72 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:49.084461 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cdb78c35-a4a3-47e0-8716-738898504f72 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:49.085262 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cdb78c35-a4a3-47e0-8716-738898504f72 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:49.085706 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cdb78c35-a4a3-47e0-8716-738898504f72 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:49.211088 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0272ea8c-07e9-4e01-8864-50b9251a5cb4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:49.211662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0272ea8c-07e9-4e01-8864-50b9251a5cb4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:49.218115 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0272ea8c-07e9-4e01-8864-50b9251a5cb4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:49.218563 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0272ea8c-07e9-4e01-8864-50b9251a5cb4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:49.219291 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0272ea8c-07e9-4e01-8864-50b9251a5cb4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:49.219722 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0272ea8c-07e9-4e01-8864-50b9251a5cb4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:49.221190 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-cdb78c35-a4a3-47e0-8716-738898504f72 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:49.229469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-cdb78c35-a4a3-47e0-8716-738898504f72 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1727 microversion: 2.1 time: 0.158046 Jun 16 19:00:49.230044 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 316/671] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:49 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:49.245408 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0272ea8c-07e9-4e01-8864-50b9251a5cb4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Going to try to terminate instance {{(pid=130229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:00:49.246407 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4ef2f735-a1a2-41cd-b24e-41b94d1c1b06 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:49.246911 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4ef2f735-a1a2-41cd-b24e-41b94d1c1b06 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:49.252740 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4ef2f735-a1a2-41cd-b24e-41b94d1c1b06 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:49.253192 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4ef2f735-a1a2-41cd-b24e-41b94d1c1b06 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:49.253989 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4ef2f735-a1a2-41cd-b24e-41b94d1c1b06 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:49.254428 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4ef2f735-a1a2-41cd-b24e-41b94d1c1b06 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:49.330114 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4ef2f735-a1a2-41cd-b24e-41b94d1c1b06 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087778 Jun 16 19:00:49.330832 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 317/672] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jun 16 19:00:49 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:00:49.466627 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0272ea8c-07e9-4e01-8864-50b9251a5cb4 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "DELETE /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 204 len: 0 microversion: 2.1 time: 0.258913 Jun 16 19:00:49.467152 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 356/673] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:00:49 2022] DELETE /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:00:49.475376 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c3c229a9-e694-4233-b00c-3cf3fd855f70 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:49.476164 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-c3c229a9-e694-4233-b00c-3cf3fd855f70 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:49.483098 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c3c229a9-e694-4233-b00c-3cf3fd855f70 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:49.483549 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c3c229a9-e694-4233-b00c-3cf3fd855f70 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:49.484578 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c3c229a9-e694-4233-b00c-3cf3fd855f70 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:49.485002 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c3c229a9-e694-4233-b00c-3cf3fd855f70 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:49.952733 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c3c229a9-e694-4233-b00c-3cf3fd855f70 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:49.960129 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-c3c229a9-e694-4233-b00c-3cf3fd855f70 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1514 microversion: 2.1 time: 0.488725 Jun 16 19:00:49.960684 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 318/674] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:49 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1514 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:50.530826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-4181aaf3-6fcc-48b1-b92a-c4a9ecdef01f req-002c45ff-8004-440f-a7be-e2cdefdf5827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88123824-1b55-41ca-a29f-0d3e0edd3d1d", "tag": "2fb01582-cf21-44de-8d3e-18570d242041"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:50.539752 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-4181aaf3-6fcc-48b1-b92a-c4a9ecdef01f req-002c45ff-8004-440f-a7be-e2cdefdf5827 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:50.540281 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-4181aaf3-6fcc-48b1-b92a-c4a9ecdef01f req-002c45ff-8004-440f-a7be-e2cdefdf5827 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:50.557211 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-4181aaf3-6fcc-48b1-b92a-c4a9ecdef01f req-002c45ff-8004-440f-a7be-e2cdefdf5827 service nova] Creating event network-changed:2fb01582-cf21-44de-8d3e-18570d242041 for instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d on hv-cinder-84617 Jun 16 19:00:50.562227 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-4181aaf3-6fcc-48b1-b92a-c4a9ecdef01f req-002c45ff-8004-440f-a7be-e2cdefdf5827 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035490 Jun 16 19:00:50.562917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 357/675] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:00:50.978745 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-21f5f7ac-332e-490d-82ec-c0b826f090d7 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:50.979363 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-21f5f7ac-332e-490d-82ec-c0b826f090d7 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:50.985953 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-21f5f7ac-332e-490d-82ec-c0b826f090d7 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:50.986396 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-21f5f7ac-332e-490d-82ec-c0b826f090d7 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:50.987154 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-21f5f7ac-332e-490d-82ec-c0b826f090d7 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:50.987588 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-21f5f7ac-332e-490d-82ec-c0b826f090d7 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:51.114178 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-21f5f7ac-332e-490d-82ec-c0b826f090d7 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:51.122471 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-21f5f7ac-332e-490d-82ec-c0b826f090d7 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1514 microversion: 2.1 time: 0.148215 Jun 16 19:00:51.123041 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 319/676] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:50 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:52.140206 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-db20bf5c-86ff-43d7-bf69-78e19134a957 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:52.140905 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-db20bf5c-86ff-43d7-bf69-78e19134a957 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:52.147341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-db20bf5c-86ff-43d7-bf69-78e19134a957 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:52.148022 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-db20bf5c-86ff-43d7-bf69-78e19134a957 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:52.148809 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-db20bf5c-86ff-43d7-bf69-78e19134a957 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:52.149276 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-db20bf5c-86ff-43d7-bf69-78e19134a957 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:52.230313 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-db20bf5c-86ff-43d7-bf69-78e19134a957 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed09fa6ecf14635949417f19c8a3af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e16a74b1bc56455b8f60bfc28bc94afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:52.237853 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-db20bf5c-86ff-43d7-bf69-78e19134a957 tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 200 len: 1472 microversion: 2.1 time: 0.102384 Jun 16 19:00:52.238411 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 358/677] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:52 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 1472 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:52.577200 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-fd505505-8ee9-42fe-9d49-e0f5c738ad93 req-f5eb0fbd-5c0b-448b-ac26-3ceec3dc7e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88123824-1b55-41ca-a29f-0d3e0edd3d1d", "tag": "2fb01582-cf21-44de-8d3e-18570d242041"}, {"server_uuid": "06d390f1-f370-40cd-bb8f-718895371ba3", "name": "network-vif-deleted", "tag": "ab068e39-8b7f-4539-b0c1-6a81612e51fd"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:52.587884 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-fd505505-8ee9-42fe-9d49-e0f5c738ad93 req-f5eb0fbd-5c0b-448b-ac26-3ceec3dc7e6d service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:52.588468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-fd505505-8ee9-42fe-9d49-e0f5c738ad93 req-f5eb0fbd-5c0b-448b-ac26-3ceec3dc7e6d service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:52.601050 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-fd505505-8ee9-42fe-9d49-e0f5c738ad93 req-f5eb0fbd-5c0b-448b-ac26-3ceec3dc7e6d service nova] Creating event network-changed:2fb01582-cf21-44de-8d3e-18570d242041 for instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d on hv-cinder-84617 Jun 16 19:00:52.601702 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-fd505505-8ee9-42fe-9d49-e0f5c738ad93 req-f5eb0fbd-5c0b-448b-ac26-3ceec3dc7e6d service nova] Creating event network-vif-deleted:ab068e39-8b7f-4539-b0c1-6a81612e51fd for instance 06d390f1-f370-40cd-bb8f-718895371ba3 on hv-cinder-84617 Jun 16 19:00:52.608306 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-fd505505-8ee9-42fe-9d49-e0f5c738ad93 req-f5eb0fbd-5c0b-448b-ac26-3ceec3dc7e6d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.034727 Jun 16 19:00:52.608912 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 320/678] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:00:53.255710 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-2b17ae7b-6a0b-4589-bf4a-7b31a455266b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:53.256251 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-2b17ae7b-6a0b-4589-bf4a-7b31a455266b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] [instance: 06d390f1-f370-40cd-bb8f-718895371ba3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:53.262632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2b17ae7b-6a0b-4589-bf4a-7b31a455266b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:53.263138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2b17ae7b-6a0b-4589-bf4a-7b31a455266b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:53.263899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2b17ae7b-6a0b-4589-bf4a-7b31a455266b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:53.264352 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2b17ae7b-6a0b-4589-bf4a-7b31a455266b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:53.278091 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-2b17ae7b-6a0b-4589-bf4a-7b31a455266b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] HTTP exception thrown: Instance 06d390f1-f370-40cd-bb8f-718895371ba3 could not be found. Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-2b17ae7b-6a0b-4589-bf4a-7b31a455266b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Request method failure captured: Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 HTTP/1.1 Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq30uLM9uoMqMdFD01g1zD5OkzCfnlHOtjJsW8Ml037RRLthLFbGfiBd0oOoS5wJDouJPCxnB_j0mvIUZIo7iH18emFdSM4PkSdBoH3HNhG2euwhT1hGhwz1ocT3BUkTKvKoa9JN5USpO-dNZAyAF8k0XM8_n0lI1P_cEvDZfP_VGRlM Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: e16a74b1bc56455b8f60bfc28bc94afb Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-VolumesSnapshotTestJSON-129707427 Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:00:53.280745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:00:53.282293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e16a74b1bc56455b8f60bfc28bc94afb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_e16a74b1bc56455b8f60bfc28bc94afb", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/e16a74b1bc56455b8f60bfc28bc94afb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/e16a74b1bc56455b8f60bfc28bc94afb"}]}] Jun 16 19:00:53.282293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-VolumesSnapshotTestJSON-129707427 Jun 16 19:00:53.282293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: e16a74b1bc56455b8f60bfc28bc94afb Jun 16 19:00:53.282293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-129707427 Jun 16 19:00:53.282293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-VolumesSnapshotTestJSON-129707427-project Jun 16 19:00:53.282293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:00:53.282293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:00:53.282293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: eed09fa6ecf14635949417f19c8a3af0 Jun 16 19:00:53.282293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-VolumesSnapshotTestJSON-129707427-project Jun 16 19:00:53.282293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:00:53.282293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance 06d390f1-f370-40cd-bb8f-718895371ba3 could not be found. Jun 16 19:00:53.282293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': '06d390f1-f370-40cd-bb8f-718895371ba3'} Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d390f1-f370-40cd-bb8f-718895371ba3 could not be found. Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:00:53.283138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d390f1-f370-40cd-bb8f-718895371ba3 could not be found. Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d390f1-f370-40cd-bb8f-718895371ba3 could not be found. Jun 16 19:00:53.284960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:00:53.286375 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-2b17ae7b-6a0b-4589-bf4a-7b31a455266b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] Returning 404 to user: Instance 06d390f1-f370-40cd-bb8f-718895371ba3 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:00:53.286375 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-2b17ae7b-6a0b-4589-bf4a-7b31a455266b tempest-VolumesSnapshotTestJSON-129707427 tempest-VolumesSnapshotTestJSON-129707427-project] 10.222.0.81 "GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3" status: 404 len: 111 microversion: 2.1 time: 0.031195 Jun 16 19:00:53.286375 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 359/679] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:53 2022] GET /compute/v2.1/servers/06d390f1-f370-40cd-bb8f-718895371ba3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:00:58.545384 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-145ed2c4-bed3-431a-a641-c2cb3850a846 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:58.545960 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-145ed2c4-bed3-431a-a641-c2cb3850a846 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:58.552869 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-145ed2c4-bed3-431a-a641-c2cb3850a846 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:58.558109 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-145ed2c4-bed3-431a-a641-c2cb3850a846 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:58.558109 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-145ed2c4-bed3-431a-a641-c2cb3850a846 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:58.558109 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-145ed2c4-bed3-431a-a641-c2cb3850a846 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:58.584064 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-145ed2c4-bed3-431a-a641-c2cb3850a846 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/os-volume_attachments/82bf0a56-37d5-419c-86b3-d7135a82338f" status: 200 len: 194 microversion: 2.20 time: 0.043536 Jun 16 19:00:58.584654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 321/680] 10.222.0.81 () {60 vars in 1453 bytes} [Thu Jun 16 19:00:58 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/os-volume_attachments/82bf0a56-37d5-419c-86b3-d7135a82338f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:00:58.646766 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9f975483-0a1a-4aa9-bf5c-28b3eccb035c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:58.647296 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9f975483-0a1a-4aa9-bf5c-28b3eccb035c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:58.653943 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9f975483-0a1a-4aa9-bf5c-28b3eccb035c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:58.654390 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9f975483-0a1a-4aa9-bf5c-28b3eccb035c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:58.655143 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9f975483-0a1a-4aa9-bf5c-28b3eccb035c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:58.655574 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9f975483-0a1a-4aa9-bf5c-28b3eccb035c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:58.734171 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-9f975483-0a1a-4aa9-bf5c-28b3eccb035c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lazy-loading 'services' on Instance uuid d6c04798-b061-421b-9b61-db9cce7dace4 {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:00:58.917848 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9f975483-0a1a-4aa9-bf5c-28b3eccb035c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/os-volume_attachments/82bf0a56-37d5-419c-86b3-d7135a82338f" status: 202 len: 0 microversion: 2.20 time: 0.274942 Jun 16 19:00:58.918410 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 360/681] 10.222.0.81 () {60 vars in 1456 bytes} [Thu Jun 16 19:00:58 2022] DELETE /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/os-volume_attachments/82bf0a56-37d5-419c-86b3-d7135a82338f => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:00:58.927979 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5b3dfab7-77fb-4f13-b4ec-b8d629c06bff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:58.928911 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5b3dfab7-77fb-4f13-b4ec-b8d629c06bff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:58.935014 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5b3dfab7-77fb-4f13-b4ec-b8d629c06bff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:58.935467 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5b3dfab7-77fb-4f13-b4ec-b8d629c06bff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:58.936249 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5b3dfab7-77fb-4f13-b4ec-b8d629c06bff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:58.936712 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5b3dfab7-77fb-4f13-b4ec-b8d629c06bff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:58.965756 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5b3dfab7-77fb-4f13-b4ec-b8d629c06bff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043074 Jun 16 19:00:58.966308 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 322/682] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jun 16 19:00:58 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:00:59.854647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:00:59.859301 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Thu Jun 16 19:00:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:00:59.978900 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-35ffd2b1-826f-47fa-9470-e660c000a241 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:59.980486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-35ffd2b1-826f-47fa-9470-e660c000a241 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:59.987164 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-35ffd2b1-826f-47fa-9470-e660c000a241 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:59.987611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-35ffd2b1-826f-47fa-9470-e660c000a241 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:59.988379 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-35ffd2b1-826f-47fa-9470-e660c000a241 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:59.988837 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-35ffd2b1-826f-47fa-9470-e660c000a241 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:00.018577 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-35ffd2b1-826f-47fa-9470-e660c000a241 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045258 Jun 16 19:01:00.019130 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 361/683] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jun 16 19:00:59 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:01:01.030866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-61ecd3c5-e662-4c8a-976c-efc343c3ab1a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:01.031828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-61ecd3c5-e662-4c8a-976c-efc343c3ab1a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:01.039117 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-61ecd3c5-e662-4c8a-976c-efc343c3ab1a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:01.039566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-61ecd3c5-e662-4c8a-976c-efc343c3ab1a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:01.040365 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-61ecd3c5-e662-4c8a-976c-efc343c3ab1a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:01.041420 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-61ecd3c5-e662-4c8a-976c-efc343c3ab1a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:01.068847 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-61ecd3c5-e662-4c8a-976c-efc343c3ab1a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041975 Jun 16 19:01:01.069437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 323/684] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jun 16 19:01:01 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:01.126856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e90508dd-ab43-4e75-93ed-3dfb447ae68e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:01.127412 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e90508dd-ab43-4e75-93ed-3dfb447ae68e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:01.133751 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e90508dd-ab43-4e75-93ed-3dfb447ae68e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:01.134200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e90508dd-ab43-4e75-93ed-3dfb447ae68e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:01.134962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e90508dd-ab43-4e75-93ed-3dfb447ae68e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:01.135397 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e90508dd-ab43-4e75-93ed-3dfb447ae68e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:01.160551 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e90508dd-ab43-4e75-93ed-3dfb447ae68e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Going to try to terminate instance {{(pid=130229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:01:01.427044 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e90508dd-ab43-4e75-93ed-3dfb447ae68e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 204 len: 0 microversion: 2.20 time: 0.303723 Jun 16 19:01:01.427735 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 362/685] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jun 16 19:01:01 2022] DELETE /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 19:01:01.436567 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-23fcf771-a1ef-4b9f-95e7-02674bd6f094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:01.437180 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-23fcf771-a1ef-4b9f-95e7-02674bd6f094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:01.443709 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-23fcf771-a1ef-4b9f-95e7-02674bd6f094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:01.445561 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-23fcf771-a1ef-4b9f-95e7-02674bd6f094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:01.445561 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-23fcf771-a1ef-4b9f-95e7-02674bd6f094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:01.445765 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-23fcf771-a1ef-4b9f-95e7-02674bd6f094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:01.579460 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-23fcf771-a1ef-4b9f-95e7-02674bd6f094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:01.587414 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-23fcf771-a1ef-4b9f-95e7-02674bd6f094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:01.589061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-23fcf771-a1ef-4b9f-95e7-02674bd6f094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:01.590278 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-23fcf771-a1ef-4b9f-95e7-02674bd6f094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.157661 Jun 16 19:01:01.590972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 324/686] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:01 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:02.609620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3a228032-e784-4424-8939-0d4a73c75f55 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:02.610391 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3a228032-e784-4424-8939-0d4a73c75f55 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:02.612759 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:02.617710 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3a228032-e784-4424-8939-0d4a73c75f55 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:02.618152 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3a228032-e784-4424-8939-0d4a73c75f55 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:02.618997 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3a228032-e784-4424-8939-0d4a73c75f55 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:02.619931 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3a228032-e784-4424-8939-0d4a73c75f55 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:02.757375 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3a228032-e784-4424-8939-0d4a73c75f55 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:02.767059 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3a228032-e784-4424-8939-0d4a73c75f55 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:02.768728 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3a228032-e784-4424-8939-0d4a73c75f55 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:02.769997 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3a228032-e784-4424-8939-0d4a73c75f55 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.164742 Jun 16 19:01:02.771929 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 363/687] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:02 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:03.791820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-54e583d2-7340-47b6-bd3e-82fb6f9eb74b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:03.792437 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-54e583d2-7340-47b6-bd3e-82fb6f9eb74b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:03.799323 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-54e583d2-7340-47b6-bd3e-82fb6f9eb74b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:03.799777 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-54e583d2-7340-47b6-bd3e-82fb6f9eb74b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:03.800539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-54e583d2-7340-47b6-bd3e-82fb6f9eb74b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:03.801189 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-54e583d2-7340-47b6-bd3e-82fb6f9eb74b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:04.017384 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-54e583d2-7340-47b6-bd3e-82fb6f9eb74b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:04.026302 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-54e583d2-7340-47b6-bd3e-82fb6f9eb74b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:04.027812 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-54e583d2-7340-47b6-bd3e-82fb6f9eb74b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:04.028989 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-54e583d2-7340-47b6-bd3e-82fb6f9eb74b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1722 microversion: 2.20 time: 0.241007 Jun 16 19:01:04.029584 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 325/688] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:03 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:01:04.704720 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-a8e16dfe-6e56-440e-abfb-65c5ad21a0f5 req-cee11a6d-6871-4bd0-947e-f7763a4b4960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c04798-b061-421b-9b61-db9cce7dace4", "name": "network-vif-deleted", "tag": "44fe652d-5231-4810-99fa-21c58c429e9c"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:04.713934 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-a8e16dfe-6e56-440e-abfb-65c5ad21a0f5 req-cee11a6d-6871-4bd0-947e-f7763a4b4960 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:04.715324 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-a8e16dfe-6e56-440e-abfb-65c5ad21a0f5 req-cee11a6d-6871-4bd0-947e-f7763a4b4960 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:04.726767 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-a8e16dfe-6e56-440e-abfb-65c5ad21a0f5 req-cee11a6d-6871-4bd0-947e-f7763a4b4960 service nova] Creating event network-vif-deleted:44fe652d-5231-4810-99fa-21c58c429e9c for instance d6c04798-b061-421b-9b61-db9cce7dace4 on hv-cinder-84617 Jun 16 19:01:04.732579 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-a8e16dfe-6e56-440e-abfb-65c5ad21a0f5 req-cee11a6d-6871-4bd0-947e-f7763a4b4960 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033219 Jun 16 19:01:04.733579 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 364/689] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:05.048018 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-97373e12-3b77-4887-bc3b-60e2bb58273e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:05.048903 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-97373e12-3b77-4887-bc3b-60e2bb58273e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:05.055506 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-97373e12-3b77-4887-bc3b-60e2bb58273e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:05.056056 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-97373e12-3b77-4887-bc3b-60e2bb58273e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:05.056947 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-97373e12-3b77-4887-bc3b-60e2bb58273e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:05.057506 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-97373e12-3b77-4887-bc3b-60e2bb58273e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:05.120239 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-97373e12-3b77-4887-bc3b-60e2bb58273e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:05.128960 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-97373e12-3b77-4887-bc3b-60e2bb58273e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:05.130609 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-97373e12-3b77-4887-bc3b-60e2bb58273e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:05.131972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-97373e12-3b77-4887-bc3b-60e2bb58273e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1654 microversion: 2.20 time: 0.087965 Jun 16 19:01:05.132591 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 326/690] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:05 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1654 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:06.150532 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4ab85419-92a5-4e61-b1fb-c2c52ad0869b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:06.151229 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4ab85419-92a5-4e61-b1fb-c2c52ad0869b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:06.158567 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4ab85419-92a5-4e61-b1fb-c2c52ad0869b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:06.159010 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4ab85419-92a5-4e61-b1fb-c2c52ad0869b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:06.159770 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4ab85419-92a5-4e61-b1fb-c2c52ad0869b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:06.160208 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4ab85419-92a5-4e61-b1fb-c2c52ad0869b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:06.222081 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4ab85419-92a5-4e61-b1fb-c2c52ad0869b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:06.230792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4ab85419-92a5-4e61-b1fb-c2c52ad0869b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:06.232329 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4ab85419-92a5-4e61-b1fb-c2c52ad0869b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:06.233568 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4ab85419-92a5-4e61-b1fb-c2c52ad0869b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1654 microversion: 2.20 time: 0.087359 Jun 16 19:01:06.239244 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 365/691] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:06 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1654 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:07.252535 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-67c389dd-dac2-4d8d-ac1e-93e5cb91d9c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:07.253126 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-67c389dd-dac2-4d8d-ac1e-93e5cb91d9c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:07.259718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67c389dd-dac2-4d8d-ac1e-93e5cb91d9c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:07.260076 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67c389dd-dac2-4d8d-ac1e-93e5cb91d9c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:07.260840 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67c389dd-dac2-4d8d-ac1e-93e5cb91d9c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:07.261931 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67c389dd-dac2-4d8d-ac1e-93e5cb91d9c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:07.324862 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-67c389dd-dac2-4d8d-ac1e-93e5cb91d9c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:07.332749 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-67c389dd-dac2-4d8d-ac1e-93e5cb91d9c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:07.334280 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-67c389dd-dac2-4d8d-ac1e-93e5cb91d9c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:07.335436 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-67c389dd-dac2-4d8d-ac1e-93e5cb91d9c7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 200 len: 1654 microversion: 2.20 time: 0.086848 Jun 16 19:01:07.335989 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 327/692] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:07 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 1654 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:07.908118 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-98a8a1f5-e043-4765-9560-0450c4fae6f8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:07.909088 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-98a8a1f5-e043-4765-9560-0450c4fae6f8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:07.915859 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-98a8a1f5-e043-4765-9560-0450c4fae6f8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:07.916310 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-98a8a1f5-e043-4765-9560-0450c4fae6f8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:07.917125 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-98a8a1f5-e043-4765-9560-0450c4fae6f8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:07.918137 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-98a8a1f5-e043-4765-9560-0450c4fae6f8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:07.945876 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-98a8a1f5-e043-4765-9560-0450c4fae6f8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041883 Jun 16 19:01:07.946418 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 366/693] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:01:07 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:01:08.003167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-acb1bf48-6710-4ae2-9d97-d768b5a27513 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:08.003673 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-acb1bf48-6710-4ae2-9d97-d768b5a27513 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:08.009920 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-acb1bf48-6710-4ae2-9d97-d768b5a27513 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:08.010379 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-acb1bf48-6710-4ae2-9d97-d768b5a27513 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:08.011151 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-acb1bf48-6710-4ae2-9d97-d768b5a27513 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:08.012162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-acb1bf48-6710-4ae2-9d97-d768b5a27513 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:08.038106 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-acb1bf48-6710-4ae2-9d97-d768b5a27513 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Going to try to terminate instance {{(pid=130230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:01:08.069029 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:08.273198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-acb1bf48-6710-4ae2-9d97-d768b5a27513 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 204 len: 0 microversion: 2.1 time: 0.273627 Jun 16 19:01:08.274138 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 328/694] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:01:07 2022] DELETE /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:01:08.283290 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0dc841ba-b183-41ab-ba90-33d73616c884 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:08.284061 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0dc841ba-b183-41ab-ba90-33d73616c884 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:08.291062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0dc841ba-b183-41ab-ba90-33d73616c884 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:08.291517 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0dc841ba-b183-41ab-ba90-33d73616c884 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:08.292290 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0dc841ba-b183-41ab-ba90-33d73616c884 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:08.292911 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0dc841ba-b183-41ab-ba90-33d73616c884 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:08.353328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-87553f54-ff6f-495a-b0a1-21066e9fdf60 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:08.354035 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-87553f54-ff6f-495a-b0a1-21066e9fdf60 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:08.360257 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-87553f54-ff6f-495a-b0a1-21066e9fdf60 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:08.360715 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-87553f54-ff6f-495a-b0a1-21066e9fdf60 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:08.361543 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-87553f54-ff6f-495a-b0a1-21066e9fdf60 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:08.361985 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-87553f54-ff6f-495a-b0a1-21066e9fdf60 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:08.376884 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-87553f54-ff6f-495a-b0a1-21066e9fdf60 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] HTTP exception thrown: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-87553f54-ff6f-495a-b0a1-21066e9fdf60 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Request method failure captured: Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 HTTP/1.1 Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq3zIXyAfD-_lX-hPxhg7kDf8KKithsOiwcaAiJwKp0Qmi1eC1jCugHhhBfE9YTSmOOh1ZOnMbHZU8rf5GbI5pVverm6er7RcXvkhmsP5a5pISO8yyi918gH8PoEDpzquByJ0Ze7_SesrJcCotcCMhRdP8qtjU8DN3n--gVkTg5P8wGY Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: 0b607bd5abec4c72842e250a639f99f1 Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:01:08.378569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:01:08.380225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b607bd5abec4c72842e250a639f99f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0b607bd5abec4c72842e250a639f99f1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b607bd5abec4c72842e250a639f99f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0b607bd5abec4c72842e250a639f99f1"}]}] Jun 16 19:01:08.380225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:01:08.380225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: 0b607bd5abec4c72842e250a639f99f1 Jun 16 19:01:08.380225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:01:08.380225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-AttachVolumeShelveTestJSON-1091211271-project Jun 16 19:01:08.380225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:01:08.380225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:01:08.380225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 2de523abbc7b4f8b972dc97b8a013237 Jun 16 19:01:08.380225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1091211271-project Jun 16 19:01:08.380225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:01:08.380225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. Jun 16 19:01:08.380225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': 'd6c04798-b061-421b-9b61-db9cce7dace4'} Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:01:08.381048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. Jun 16 19:01:08.382272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:08.383345 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-87553f54-ff6f-495a-b0a1-21066e9fdf60 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Returning 404 to user: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:01:08.383345 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-87553f54-ff6f-495a-b0a1-21066e9fdf60 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 404 len: 111 microversion: 2.20 time: 0.030946 Jun 16 19:01:08.383345 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 329/695] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:08 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:01:08.390202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-05f0bc7f-7dee-4213-9bbc-5069444b6629 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '.version_select at 0x7f2007f51ee0>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:08.493938 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-05f0bc7f-7dee-4213-9bbc-5069444b6629 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-910238746" status: 204 len: 0 microversion: 2.20 time: 0.108114 Jun 16 19:01:08.494503 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 330/696] 10.222.0.81 () {60 vars in 1258 bytes} [Thu Jun 16 19:01:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-910238746 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 19:01:08.610591 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0dc841ba-b183-41ab-ba90-33d73616c884 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:08.618622 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0dc841ba-b183-41ab-ba90-33d73616c884 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1671 microversion: 2.1 time: 0.339583 Jun 16 19:01:08.619468 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 367/697] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:08 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1671 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:09.271559 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-bf4e3a77-f81c-4881-aa46-ee53124b0a8a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Action: 'create', calling method: .version_select at 0x7f2007ea0700>, body: {"keypair": {"name": "tempest-keypair-1354684831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlcOK2DR9ibTdkmm96/rrU0LAtv7L66Wu7L7Ir4SNuQtgxCwPxxYxBmTwbtg0c5LO5pLfhYF+iJWx4OLTXAUWbsxWsKCfC1zDHfkimm2oOPM8BnaxtwEmyPd1FoqGng8Q=="}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:09.286563 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-bf4e3a77-f81c-4881-aa46-ee53124b0a8a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Getting quotas for project 0b607bd5abec4c72842e250a639f99f1. Resources: {'key_pairs'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:01:09.290700 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-bf4e3a77-f81c-4881-aa46-ee53124b0a8a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Getting quotas for user 2de523abbc7b4f8b972dc97b8a013237 and project 0b607bd5abec4c72842e250a639f99f1. Resources: {'key_pairs'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:01:09.360457 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-bf4e3a77-f81c-4881-aa46-ee53124b0a8a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.092943 Jun 16 19:01:09.361053 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 331/698] 10.222.0.81 () {62 vars in 1199 bytes} [Thu Jun 16 19:01:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 19:01:09.563020 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:01:09.563554 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Thu Jun 16 19:01:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:01:09.636354 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e0c4cc3e-f33b-45ce-938d-1e4f385be8cf tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:09.636986 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e0c4cc3e-f33b-45ce-938d-1e4f385be8cf tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:09.643606 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e0c4cc3e-f33b-45ce-938d-1e4f385be8cf tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:09.644055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e0c4cc3e-f33b-45ce-938d-1e4f385be8cf tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:09.644812 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e0c4cc3e-f33b-45ce-938d-1e4f385be8cf tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:09.645265 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e0c4cc3e-f33b-45ce-938d-1e4f385be8cf tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:09.649839 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:09.789922 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e0c4cc3e-f33b-45ce-938d-1e4f385be8cf tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:09.797819 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e0c4cc3e-f33b-45ce-938d-1e4f385be8cf tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1671 microversion: 2.1 time: 0.165247 Jun 16 19:01:09.798394 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 368/699] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:09 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:10.291468 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:01:10.291599 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Thu Jun 16 19:01:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:01:10.770028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ba738af9-0247-4995-9d3c-a516a3942982 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:10.770617 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ba738af9-0247-4995-9d3c-a516a3942982 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:10.773015 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:10.777820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ba738af9-0247-4995-9d3c-a516a3942982 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:10.778268 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ba738af9-0247-4995-9d3c-a516a3942982 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:10.779244 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ba738af9-0247-4995-9d3c-a516a3942982 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:10.779709 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ba738af9-0247-4995-9d3c-a516a3942982 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:10.802974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.objects.instance [None req-ba738af9-0247-4995-9d3c-a516a3942982 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lazy-loading 'flavor' on Instance uuid 5bf1ba63-bf52-412b-9948-409dadbbdf18 {{(pid=130230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:01:10.817704 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-fa6c433d-e141-44e8-b38e-479fdb601648 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:10.818902 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-fa6c433d-e141-44e8-b38e-479fdb601648 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:10.828051 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fa6c433d-e141-44e8-b38e-479fdb601648 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:10.828623 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fa6c433d-e141-44e8-b38e-479fdb601648 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:10.829686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fa6c433d-e141-44e8-b38e-479fdb601648 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:10.830126 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fa6c433d-e141-44e8-b38e-479fdb601648 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:11.112226 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ba738af9-0247-4995-9d3c-a516a3942982 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "POST /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18/action" status: 202 len: 0 microversion: 2.1 time: 0.345990 Jun 16 19:01:11.113054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 332/700] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jun 16 19:01:10 2022] POST /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:01:11.122219 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f140abb2-9424-4cc7-a5dd-d8f91c43df3a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:11.122913 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f140abb2-9424-4cc7-a5dd-d8f91c43df3a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:11.129445 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f140abb2-9424-4cc7-a5dd-d8f91c43df3a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:11.129890 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f140abb2-9424-4cc7-a5dd-d8f91c43df3a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:11.130661 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f140abb2-9424-4cc7-a5dd-d8f91c43df3a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:11.131088 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f140abb2-9424-4cc7-a5dd-d8f91c43df3a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:11.173647 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-fa6c433d-e141-44e8-b38e-479fdb601648 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:11.180991 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-fa6c433d-e141-44e8-b38e-479fdb601648 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1671 microversion: 2.1 time: 0.367512 Jun 16 19:01:11.191197 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 369/701] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:10 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1671 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:11.483327 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f140abb2-9424-4cc7-a5dd-d8f91c43df3a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:11.489462 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f140abb2-9424-4cc7-a5dd-d8f91c43df3a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1568 microversion: 2.1 time: 0.372106 Jun 16 19:01:11.490041 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 333/702] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:11 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1568 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:12.007075 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-4deab209-2771-490b-9638-84ad5922e638 req-bdfad576-f68b-46eb-8ab1-6e6e36b1f5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bad769d-1b62-4d0f-8491-bfae3997a525", "name": "network-vif-deleted", "tag": "813e5e92-6255-46b0-aa69-1964caa13cf4"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:12.018880 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-4deab209-2771-490b-9638-84ad5922e638 req-bdfad576-f68b-46eb-8ab1-6e6e36b1f5a7 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:12.019322 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-4deab209-2771-490b-9638-84ad5922e638 req-bdfad576-f68b-46eb-8ab1-6e6e36b1f5a7 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:12.033733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-4deab209-2771-490b-9638-84ad5922e638 req-bdfad576-f68b-46eb-8ab1-6e6e36b1f5a7 service nova] Creating event network-vif-deleted:813e5e92-6255-46b0-aa69-1964caa13cf4 for instance 8bad769d-1b62-4d0f-8491-bfae3997a525 on hv-cinder-84617 Jun 16 19:01:12.039509 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-4deab209-2771-490b-9638-84ad5922e638 req-bdfad576-f68b-46eb-8ab1-6e6e36b1f5a7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036133 Jun 16 19:01:12.040732 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 370/703] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:01:12.199416 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-cd803227-7417-4cc9-bcbb-e65b3721ee3a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:12.200293 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-cd803227-7417-4cc9-bcbb-e65b3721ee3a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:12.207648 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cd803227-7417-4cc9-bcbb-e65b3721ee3a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:12.208343 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cd803227-7417-4cc9-bcbb-e65b3721ee3a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:12.209333 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cd803227-7417-4cc9-bcbb-e65b3721ee3a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:12.210144 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cd803227-7417-4cc9-bcbb-e65b3721ee3a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:12.291988 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-cd803227-7417-4cc9-bcbb-e65b3721ee3a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:12.300520 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-cd803227-7417-4cc9-bcbb-e65b3721ee3a tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 200 len: 1321 microversion: 2.1 time: 0.105749 Jun 16 19:01:12.301345 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 334/704] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:12 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 1321 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:12.507045 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1e65c624-2489-40e6-9bc3-29c8dc6ad973 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:12.507998 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1e65c624-2489-40e6-9bc3-29c8dc6ad973 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:12.514627 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1e65c624-2489-40e6-9bc3-29c8dc6ad973 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:12.515084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1e65c624-2489-40e6-9bc3-29c8dc6ad973 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:12.515859 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1e65c624-2489-40e6-9bc3-29c8dc6ad973 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:12.516308 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1e65c624-2489-40e6-9bc3-29c8dc6ad973 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:12.526655 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-812037240", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b63c6cac-d1b4-42bd-9dde-7d5291a4c111"}], "security_groups": [{"name": "tempest-securitygroup--54871816"}], "key_name": "tempest-keypair-1354684831", "user_data": "}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:12.679826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.network.neutron [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] validate_networks() for [('b63c6cac-d1b4-42bd-9dde-7d5291a4c111', None, None, None, None, None)] {{(pid=130229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:01:12.790135 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1e65c624-2489-40e6-9bc3-29c8dc6ad973 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:12.820237 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1e65c624-2489-40e6-9bc3-29c8dc6ad973 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1568 microversion: 2.1 time: 0.309140 Jun 16 19:01:12.822511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 335/705] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:12 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1568 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:13.317571 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3d5107cd-a95e-452d-b058-2c768f5ce2a6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:13.318259 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3d5107cd-a95e-452d-b058-2c768f5ce2a6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:13.325329 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3d5107cd-a95e-452d-b058-2c768f5ce2a6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:13.325776 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3d5107cd-a95e-452d-b058-2c768f5ce2a6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:13.326555 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3d5107cd-a95e-452d-b058-2c768f5ce2a6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:13.327116 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3d5107cd-a95e-452d-b058-2c768f5ce2a6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:13.341668 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-3d5107cd-a95e-452d-b058-2c768f5ce2a6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] HTTP exception thrown: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3d5107cd-a95e-452d-b058-2c768f5ce2a6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Request method failure captured: Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 HTTP/1.1 Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq3y-peb9hOQgKqy82HgS0nRjwmQuBBnzkVB0txQ1FbbOtziHrwoSK52YxVh5Y-SxGpqEAnPvpoQKaHh368vbacMjaCiVwbtx8CfjlLfjbun_AYqpEXGeprB7XVw3hLwzU47hRfbXRNYpcz01KVv-7UM0lb9tNreDwFbQPk4MsAc457E Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: f9e5f71068aa4d75bcc4578b741f490d Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:01:13.343967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:01:13.345274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f9e5f71068aa4d75bcc4578b741f490d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f9e5f71068aa4d75bcc4578b741f490d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f9e5f71068aa4d75bcc4578b741f490d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f9e5f71068aa4d75bcc4578b741f490d"}]}] Jun 16 19:01:13.345274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:01:13.345274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: f9e5f71068aa4d75bcc4578b741f490d Jun 16 19:01:13.345274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:01:13.345274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-AttachVolumeTestJSON-630145281-project Jun 16 19:01:13.345274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:01:13.345274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:01:13.345274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: fec4e3ac2e44403b9d45b37b5a6f64a9 Jun 16 19:01:13.345274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-AttachVolumeTestJSON-630145281-project Jun 16 19:01:13.345274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:01:13.345274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. Jun 16 19:01:13.345274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': '8bad769d-1b62-4d0f-8491-bfae3997a525'} Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:01:13.348914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. Jun 16 19:01:13.350198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:13.351246 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3d5107cd-a95e-452d-b058-2c768f5ce2a6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Returning 404 to user: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:01:13.351246 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3d5107cd-a95e-452d-b058-2c768f5ce2a6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 404 len: 111 microversion: 2.1 time: 0.031933 Jun 16 19:01:13.351246 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 336/706] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:13 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:01:13.355800 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6bfdf7f5-835b-41e6-9222-6250f84eb43c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '.version_select at 0x7f2007ef14c0>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:13.411483 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Flavor limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:01:13.411952 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Image limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:01:13.412360 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Flavor pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:01:13.412768 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Image pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:01:13.413172 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:01:13.422488 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:13.422930 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:13.423710 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:13.424141 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:13.436992 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6bfdf7f5-835b-41e6-9222-6250f84eb43c tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-74238525" status: 202 len: 0 microversion: 2.1 time: 0.086228 Jun 16 19:01:13.437628 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 337/707] 10.222.0.81 () {58 vars in 1214 bytes} [Thu Jun 16 19:01:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-74238525 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:01:13.444828 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Getting quotas for project 0b607bd5abec4c72842e250a639f99f1. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:01:13.447547 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Getting quotas for user 2de523abbc7b4f8b972dc97b8a013237 and project 0b607bd5abec4c72842e250a639f99f1. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:01:13.458921 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Going to run 1 instances... {{(pid=130229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:01:13.461302 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:01:13.552283 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0a6984c9-86d0-48cb-9fb2-28d533d07929 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.086353 Jun 16 19:01:13.553127 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 371/708] 10.222.0.81 () {62 vars in 1187 bytes} [Thu Jun 16 19:01:12 2022] POST /compute/v2.1/servers => generated 400 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 19:01:13.564839 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f7e473e9-4cd3-48bf-b21d-c9420b138fde tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:13.565482 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f7e473e9-4cd3-48bf-b21d-c9420b138fde tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:13.619524 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f7e473e9-4cd3-48bf-b21d-c9420b138fde tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:13.628827 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f7e473e9-4cd3-48bf-b21d-c9420b138fde tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:13.630698 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f7e473e9-4cd3-48bf-b21d-c9420b138fde tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:13.631478 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f7e473e9-4cd3-48bf-b21d-c9420b138fde tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1281 microversion: 2.20 time: 0.071258 Jun 16 19:01:13.632028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 338/709] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:13 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:13.850027 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5c9c94d0-2167-4c54-ae46-e3a59df3d6e8 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:13.850740 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5c9c94d0-2167-4c54-ae46-e3a59df3d6e8 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:13.860728 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5c9c94d0-2167-4c54-ae46-e3a59df3d6e8 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:13.861190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5c9c94d0-2167-4c54-ae46-e3a59df3d6e8 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:13.863094 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5c9c94d0-2167-4c54-ae46-e3a59df3d6e8 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:13.863094 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5c9c94d0-2167-4c54-ae46-e3a59df3d6e8 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:14.016394 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5c9c94d0-2167-4c54-ae46-e3a59df3d6e8 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:14.027934 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5c9c94d0-2167-4c54-ae46-e3a59df3d6e8 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1568 microversion: 2.1 time: 0.181822 Jun 16 19:01:14.028827 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 372/710] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:13 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:14.268761 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-52722f38-ab46-4ff2-87a0-e43e475d76d9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Action: 'create', calling method: .version_select at 0x7f2007ef1430>, body: {"keypair": {"name": "tempest-keypair-1415332267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7i1FEnK8hS6R3rvFUeNgQu+3onlthXZX6dDhGyysy++Jar4hHOIGD0QfFPC8WrZxrJ1N1jnPnt0Dfpbh6pj3mhTe80icmo2aXV1pYkwYTA6uFBn7G4EmCCzMQAbO2GWQ=="}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:14.283475 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-52722f38-ab46-4ff2-87a0-e43e475d76d9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Getting quotas for project f9e5f71068aa4d75bcc4578b741f490d. Resources: {'key_pairs'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:01:14.287603 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-52722f38-ab46-4ff2-87a0-e43e475d76d9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Getting quotas for user fec4e3ac2e44403b9d45b37b5a6f64a9 and project f9e5f71068aa4d75bcc4578b741f490d. Resources: {'key_pairs'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:01:14.361005 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-52722f38-ab46-4ff2-87a0-e43e475d76d9 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096106 Jun 16 19:01:14.362056 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 339/711] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jun 16 19:01:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:14.649136 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-bf944374-831e-48fd-8b2b-da3989b631a7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:14.650022 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-bf944374-831e-48fd-8b2b-da3989b631a7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:14.657436 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bf944374-831e-48fd-8b2b-da3989b631a7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:14.657750 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bf944374-831e-48fd-8b2b-da3989b631a7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:14.658534 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bf944374-831e-48fd-8b2b-da3989b631a7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:14.658973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bf944374-831e-48fd-8b2b-da3989b631a7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:14.724899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-bf944374-831e-48fd-8b2b-da3989b631a7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:14.733985 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-bf944374-831e-48fd-8b2b-da3989b631a7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:14.735577 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-bf944374-831e-48fd-8b2b-da3989b631a7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:14.736700 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-bf944374-831e-48fd-8b2b-da3989b631a7 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1285 microversion: 2.20 time: 0.092000 Jun 16 19:01:14.738062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 373/712] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:14 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:15.044527 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-0386c44b-49cc-4b04-963e-a343f9d91573 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:15.045069 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-0386c44b-49cc-4b04-963e-a343f9d91573 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:15.051148 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0386c44b-49cc-4b04-963e-a343f9d91573 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:15.051593 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0386c44b-49cc-4b04-963e-a343f9d91573 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:15.052358 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0386c44b-49cc-4b04-963e-a343f9d91573 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:15.052788 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0386c44b-49cc-4b04-963e-a343f9d91573 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:15.189292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-0386c44b-49cc-4b04-963e-a343f9d91573 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:15.196916 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-0386c44b-49cc-4b04-963e-a343f9d91573 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1568 microversion: 2.1 time: 0.156850 Jun 16 19:01:15.197509 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 340/713] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:15 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:15.756330 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-be970f09-9737-43b8-8d96-6be4ed67750b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:15.757095 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-be970f09-9737-43b8-8d96-6be4ed67750b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:15.765123 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-be970f09-9737-43b8-8d96-6be4ed67750b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:15.765703 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-be970f09-9737-43b8-8d96-6be4ed67750b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:15.766847 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-be970f09-9737-43b8-8d96-6be4ed67750b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:15.767481 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-be970f09-9737-43b8-8d96-6be4ed67750b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:15.837874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-be970f09-9737-43b8-8d96-6be4ed67750b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:15.846924 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-be970f09-9737-43b8-8d96-6be4ed67750b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:15.848337 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-be970f09-9737-43b8-8d96-6be4ed67750b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:15.849484 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-be970f09-9737-43b8-8d96-6be4ed67750b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1341 microversion: 2.20 time: 0.097780 Jun 16 19:01:15.850041 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 374/714] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:15 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1341 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:16.220622 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-28e632e0-0c5e-4e3a-908b-4ff5dc49f24b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:16.221401 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-28e632e0-0c5e-4e3a-908b-4ff5dc49f24b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:16.227967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-28e632e0-0c5e-4e3a-908b-4ff5dc49f24b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:16.228408 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-28e632e0-0c5e-4e3a-908b-4ff5dc49f24b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:16.229391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-28e632e0-0c5e-4e3a-908b-4ff5dc49f24b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:16.229815 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-28e632e0-0c5e-4e3a-908b-4ff5dc49f24b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:16.410821 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-28e632e0-0c5e-4e3a-908b-4ff5dc49f24b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:16.420351 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-28e632e0-0c5e-4e3a-908b-4ff5dc49f24b tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1568 microversion: 2.1 time: 0.203494 Jun 16 19:01:16.420890 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 341/715] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:16 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:16.525349 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1528704242", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "64614a18-07e0-43ad-9990-55ab159f858f"}], "security_groups": [{"name": "tempest-securitygroup--1448226738"}], "key_name": "tempest-keypair-1415332267", "user_data": "}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:16.694372 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.network.neutron [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] validate_networks() for [('64614a18-07e0-43ad-9990-55ab159f858f', None, None, None, None, None)] {{(pid=130229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:01:16.870574 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c771dfcc-50b5-4ad0-93f0-b31178fd0258 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:16.871352 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-c771dfcc-50b5-4ad0-93f0-b31178fd0258 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:16.878184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c771dfcc-50b5-4ad0-93f0-b31178fd0258 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:16.878623 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c771dfcc-50b5-4ad0-93f0-b31178fd0258 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:16.879378 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c771dfcc-50b5-4ad0-93f0-b31178fd0258 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:16.879807 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c771dfcc-50b5-4ad0-93f0-b31178fd0258 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:17.198774 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c771dfcc-50b5-4ad0-93f0-b31178fd0258 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:17.207259 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c771dfcc-50b5-4ad0-93f0-b31178fd0258 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:17.208951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c771dfcc-50b5-4ad0-93f0-b31178fd0258 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:17.210142 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-c771dfcc-50b5-4ad0-93f0-b31178fd0258 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1405 microversion: 2.20 time: 0.344224 Jun 16 19:01:17.210715 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 342/716] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:16 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1405 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:01:17.398028 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Flavor limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:01:17.399421 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Image limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:01:17.399753 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Flavor pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:01:17.400646 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Image pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:01:17.401067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:01:17.411828 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:17.412283 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:17.413093 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:17.413561 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:17.433064 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Getting quotas for project f9e5f71068aa4d75bcc4578b741f490d. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:01:17.437823 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Getting quotas for user fec4e3ac2e44403b9d45b37b5a6f64a9 and project f9e5f71068aa4d75bcc4578b741f490d. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:01:17.438759 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4da094d2-9fe6-4858-ab37-cd7573e41966 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:17.439379 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4da094d2-9fe6-4858-ab37-cd7573e41966 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:17.451370 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4da094d2-9fe6-4858-ab37-cd7573e41966 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:17.452656 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4da094d2-9fe6-4858-ab37-cd7573e41966 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:17.453854 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4da094d2-9fe6-4858-ab37-cd7573e41966 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:17.456913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Going to run 1 instances... {{(pid=130229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:01:17.457196 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4da094d2-9fe6-4858-ab37-cd7573e41966 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:17.457415 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:01:17.552295 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-817d5b46-ef95-49a7-9f12-846e1a58b9c8 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.032031 Jun 16 19:01:17.553556 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 375/717] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 19:01:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:01:17.569769 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d6409dc0-9c89-49d6-a1b5-d69d67168281 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:17.570814 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d6409dc0-9c89-49d6-a1b5-d69d67168281 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:17.672210 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d6409dc0-9c89-49d6-a1b5-d69d67168281 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:17.680347 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d6409dc0-9c89-49d6-a1b5-d69d67168281 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1238 microversion: 2.1 time: 0.114641 Jun 16 19:01:17.680912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 376/718] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:17 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1238 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:17.709924 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4da094d2-9fe6-4858-ab37-cd7573e41966 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:17.718853 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4da094d2-9fe6-4858-ab37-cd7573e41966 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1568 microversion: 2.1 time: 0.285844 Jun 16 19:01:17.719431 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 343/719] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:17 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1568 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:17.812990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-6969242f-24b8-4bba-b19c-7581164d23e6 req-79f40b77-ffbe-4466-b49a-a0a9bfe1cb3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33ad0030-d602-4eda-932c-e5a9ff1a7339", "tag": "876dcbc0-6957-426a-86fc-525cbbd501e9"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:17.825429 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-6969242f-24b8-4bba-b19c-7581164d23e6 req-79f40b77-ffbe-4466-b49a-a0a9bfe1cb3a service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:17.825878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-6969242f-24b8-4bba-b19c-7581164d23e6 req-79f40b77-ffbe-4466-b49a-a0a9bfe1cb3a service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:17.837532 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-6969242f-24b8-4bba-b19c-7581164d23e6 req-79f40b77-ffbe-4466-b49a-a0a9bfe1cb3a service nova] Creating event network-changed:876dcbc0-6957-426a-86fc-525cbbd501e9 for instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 on hv-cinder-84617 Jun 16 19:01:17.846292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-6969242f-24b8-4bba-b19c-7581164d23e6 req-79f40b77-ffbe-4466-b49a-a0a9bfe1cb3a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037322 Jun 16 19:01:17.846979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 377/720] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:18.229292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-8de04716-72ee-4f05-881c-9851fd411086 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:18.229831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-8de04716-72ee-4f05-881c-9851fd411086 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:18.236642 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8de04716-72ee-4f05-881c-9851fd411086 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:18.237349 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8de04716-72ee-4f05-881c-9851fd411086 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:18.238115 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8de04716-72ee-4f05-881c-9851fd411086 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:18.238551 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8de04716-72ee-4f05-881c-9851fd411086 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:18.451891 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8de04716-72ee-4f05-881c-9851fd411086 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:18.459823 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8de04716-72ee-4f05-881c-9851fd411086 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:18.461396 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8de04716-72ee-4f05-881c-9851fd411086 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:18.462502 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-8de04716-72ee-4f05-881c-9851fd411086 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1405 microversion: 2.20 time: 0.237560 Jun 16 19:01:18.463067 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 344/721] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:18 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:18.700185 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-466c0746-7055-4ad7-8913-8d9f2dddd9ed tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:18.700892 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-466c0746-7055-4ad7-8913-8d9f2dddd9ed tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:18.707692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-466c0746-7055-4ad7-8913-8d9f2dddd9ed tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:18.708145 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-466c0746-7055-4ad7-8913-8d9f2dddd9ed tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:18.708920 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-466c0746-7055-4ad7-8913-8d9f2dddd9ed tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:18.709404 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-466c0746-7055-4ad7-8913-8d9f2dddd9ed tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:18.736253 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1cda4f03-de54-4628-82a5-04ee561b06a4 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:18.736969 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1cda4f03-de54-4628-82a5-04ee561b06a4 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:18.745059 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cda4f03-de54-4628-82a5-04ee561b06a4 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:18.745621 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cda4f03-de54-4628-82a5-04ee561b06a4 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:18.746487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cda4f03-de54-4628-82a5-04ee561b06a4 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:18.747009 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1cda4f03-de54-4628-82a5-04ee561b06a4 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:18.772241 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-466c0746-7055-4ad7-8913-8d9f2dddd9ed tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:18.780464 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-466c0746-7055-4ad7-8913-8d9f2dddd9ed tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1242 microversion: 2.1 time: 0.086029 Jun 16 19:01:18.781037 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 378/722] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:18 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:18.878531 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1cda4f03-de54-4628-82a5-04ee561b06a4 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:18.886228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1cda4f03-de54-4628-82a5-04ee561b06a4 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1568 microversion: 2.1 time: 0.154054 Jun 16 19:01:18.887549 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 345/723] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:18 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:19.484946 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7960e01b-8561-489a-8568-3582e2320c4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:19.485699 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7960e01b-8561-489a-8568-3582e2320c4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:19.492870 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7960e01b-8561-489a-8568-3582e2320c4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:19.493569 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7960e01b-8561-489a-8568-3582e2320c4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:19.495354 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7960e01b-8561-489a-8568-3582e2320c4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:19.495354 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7960e01b-8561-489a-8568-3582e2320c4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:19.627419 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7960e01b-8561-489a-8568-3582e2320c4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:19.635363 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7960e01b-8561-489a-8568-3582e2320c4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:19.636911 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7960e01b-8561-489a-8568-3582e2320c4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:19.638056 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7960e01b-8561-489a-8568-3582e2320c4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1405 microversion: 2.20 time: 0.158073 Jun 16 19:01:19.638617 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 379/724] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:19 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:19.797487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b6fb2c7e-394f-4e4e-a1e9-3519846589ef tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:19.798107 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b6fb2c7e-394f-4e4e-a1e9-3519846589ef tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:19.804600 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b6fb2c7e-394f-4e4e-a1e9-3519846589ef tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:19.805057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b6fb2c7e-394f-4e4e-a1e9-3519846589ef tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:19.805905 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b6fb2c7e-394f-4e4e-a1e9-3519846589ef tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:19.806347 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b6fb2c7e-394f-4e4e-a1e9-3519846589ef tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:19.872599 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b6fb2c7e-394f-4e4e-a1e9-3519846589ef tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:19.886070 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b6fb2c7e-394f-4e4e-a1e9-3519846589ef tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1234 microversion: 2.1 time: 0.092902 Jun 16 19:01:19.887003 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 346/725] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:19 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1234 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:19.904585 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-446ea385-20dc-440d-b275-03d81c768c65 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:19.905904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-446ea385-20dc-440d-b275-03d81c768c65 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:19.911612 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-446ea385-20dc-440d-b275-03d81c768c65 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:19.912074 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-446ea385-20dc-440d-b275-03d81c768c65 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:19.912842 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-446ea385-20dc-440d-b275-03d81c768c65 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:19.913308 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-446ea385-20dc-440d-b275-03d81c768c65 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:20.054813 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-446ea385-20dc-440d-b275-03d81c768c65 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:20.062453 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-446ea385-20dc-440d-b275-03d81c768c65 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1568 microversion: 2.1 time: 0.162399 Jun 16 19:01:20.063014 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 380/726] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:19 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:20.655934 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-589a9324-ef1a-43e6-a6d6-5f72fc62a129 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:20.656558 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-589a9324-ef1a-43e6-a6d6-5f72fc62a129 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:20.662828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-589a9324-ef1a-43e6-a6d6-5f72fc62a129 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:20.663276 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-589a9324-ef1a-43e6-a6d6-5f72fc62a129 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:20.664045 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-589a9324-ef1a-43e6-a6d6-5f72fc62a129 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:20.664486 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-589a9324-ef1a-43e6-a6d6-5f72fc62a129 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:20.883330 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-589a9324-ef1a-43e6-a6d6-5f72fc62a129 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:20.893733 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-589a9324-ef1a-43e6-a6d6-5f72fc62a129 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:20.895413 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-589a9324-ef1a-43e6-a6d6-5f72fc62a129 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:20.896924 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-589a9324-ef1a-43e6-a6d6-5f72fc62a129 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1405 microversion: 2.20 time: 0.244797 Jun 16 19:01:20.897598 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 347/727] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:20 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:20.903477 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5653484b-8f12-48c5-8ed4-d32b33a61cce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:20.904175 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5653484b-8f12-48c5-8ed4-d32b33a61cce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:20.916524 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5653484b-8f12-48c5-8ed4-d32b33a61cce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:20.916524 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5653484b-8f12-48c5-8ed4-d32b33a61cce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:20.916524 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5653484b-8f12-48c5-8ed4-d32b33a61cce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:20.916524 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5653484b-8f12-48c5-8ed4-d32b33a61cce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:21.013201 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5653484b-8f12-48c5-8ed4-d32b33a61cce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:21.020844 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5653484b-8f12-48c5-8ed4-d32b33a61cce tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1296 microversion: 2.1 time: 0.121379 Jun 16 19:01:21.021433 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 381/728] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:20 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1296 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:21.079381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5232f6a1-258c-4210-a3d9-7804aa7818dd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:21.080039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5232f6a1-258c-4210-a3d9-7804aa7818dd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:21.086368 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5232f6a1-258c-4210-a3d9-7804aa7818dd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:21.087955 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5232f6a1-258c-4210-a3d9-7804aa7818dd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:21.087955 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5232f6a1-258c-4210-a3d9-7804aa7818dd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:21.088161 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5232f6a1-258c-4210-a3d9-7804aa7818dd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:21.538598 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5232f6a1-258c-4210-a3d9-7804aa7818dd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:21.546393 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5232f6a1-258c-4210-a3d9-7804aa7818dd tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1568 microversion: 2.1 time: 0.470898 Jun 16 19:01:21.547087 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 348/729] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:21 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1568 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:21.915316 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-aef2d535-17ab-42d4-84a4-4d1d404379ee tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:21.915932 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-aef2d535-17ab-42d4-84a4-4d1d404379ee tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:21.922590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-aef2d535-17ab-42d4-84a4-4d1d404379ee tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:21.923208 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-aef2d535-17ab-42d4-84a4-4d1d404379ee tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:21.923798 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-aef2d535-17ab-42d4-84a4-4d1d404379ee tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:21.924236 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-aef2d535-17ab-42d4-84a4-4d1d404379ee tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:22.037756 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-80d2aff0-32ee-481c-973e-eb6b2831beba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:22.038399 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-80d2aff0-32ee-481c-973e-eb6b2831beba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:22.045207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-80d2aff0-32ee-481c-973e-eb6b2831beba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:22.045552 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-80d2aff0-32ee-481c-973e-eb6b2831beba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:22.046324 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-80d2aff0-32ee-481c-973e-eb6b2831beba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:22.046762 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-80d2aff0-32ee-481c-973e-eb6b2831beba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:22.051005 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:22.298716 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-aef2d535-17ab-42d4-84a4-4d1d404379ee tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:22.306765 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-aef2d535-17ab-42d4-84a4-4d1d404379ee tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:22.308298 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-aef2d535-17ab-42d4-84a4-4d1d404379ee tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:22.310066 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-aef2d535-17ab-42d4-84a4-4d1d404379ee tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1405 microversion: 2.20 time: 0.398737 Jun 16 19:01:22.310625 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 382/730] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:21 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:22.436278 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-80d2aff0-32ee-481c-973e-eb6b2831beba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:22.443672 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-80d2aff0-32ee-481c-973e-eb6b2831beba tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1364 microversion: 2.1 time: 0.409896 Jun 16 19:01:22.444347 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 349/731] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:22 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1364 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:22.564370 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ff83332b-faa2-4cc6-b2ab-709398f047f7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:22.565155 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ff83332b-faa2-4cc6-b2ab-709398f047f7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:22.571321 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff83332b-faa2-4cc6-b2ab-709398f047f7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:22.571812 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff83332b-faa2-4cc6-b2ab-709398f047f7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:22.572616 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff83332b-faa2-4cc6-b2ab-709398f047f7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:22.573096 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ff83332b-faa2-4cc6-b2ab-709398f047f7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:22.747436 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ff83332b-faa2-4cc6-b2ab-709398f047f7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:22.754883 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ff83332b-faa2-4cc6-b2ab-709398f047f7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1568 microversion: 2.1 time: 0.194808 Jun 16 19:01:22.755456 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 383/732] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:22 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:23.108013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-c2306994-9a7a-42d2-950c-29bc9208cf70 req-cbbe86b2-ee7e-4232-baf5-1ac6830f02cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "effe0963-698f-48d6-adf3-6b53bf88e09c", "tag": "883851d6-ca58-4dd2-9dcf-af84a9421688"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:23.118627 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-c2306994-9a7a-42d2-950c-29bc9208cf70 req-cbbe86b2-ee7e-4232-baf5-1ac6830f02cf service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:23.119073 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-c2306994-9a7a-42d2-950c-29bc9208cf70 req-cbbe86b2-ee7e-4232-baf5-1ac6830f02cf service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:23.130912 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-c2306994-9a7a-42d2-950c-29bc9208cf70 req-cbbe86b2-ee7e-4232-baf5-1ac6830f02cf service nova] Creating event network-changed:883851d6-ca58-4dd2-9dcf-af84a9421688 for instance effe0963-698f-48d6-adf3-6b53bf88e09c on hv-cinder-84617 Jun 16 19:01:23.135910 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-c2306994-9a7a-42d2-950c-29bc9208cf70 req-cbbe86b2-ee7e-4232-baf5-1ac6830f02cf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031991 Jun 16 19:01:23.136548 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 350/733] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:23.328913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1949f1f4-4fef-4cf9-8540-6775142196ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:23.329553 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-1949f1f4-4fef-4cf9-8540-6775142196ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:23.336163 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1949f1f4-4fef-4cf9-8540-6775142196ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:23.336607 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1949f1f4-4fef-4cf9-8540-6775142196ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:23.337464 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1949f1f4-4fef-4cf9-8540-6775142196ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:23.337904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1949f1f4-4fef-4cf9-8540-6775142196ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:23.460490 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-91ed08dd-8112-456e-bc6c-37a7dc165b7f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:23.461112 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-91ed08dd-8112-456e-bc6c-37a7dc165b7f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:23.467460 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-91ed08dd-8112-456e-bc6c-37a7dc165b7f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:23.467913 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-91ed08dd-8112-456e-bc6c-37a7dc165b7f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:23.468683 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-91ed08dd-8112-456e-bc6c-37a7dc165b7f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:23.468787 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1949f1f4-4fef-4cf9-8540-6775142196ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:23.469120 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-91ed08dd-8112-456e-bc6c-37a7dc165b7f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:23.476779 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1949f1f4-4fef-4cf9-8540-6775142196ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:23.478283 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1949f1f4-4fef-4cf9-8540-6775142196ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:23.479378 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-1949f1f4-4fef-4cf9-8540-6775142196ae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1405 microversion: 2.20 time: 0.155159 Jun 16 19:01:23.479934 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 384/734] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:23 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:23.595379 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-91ed08dd-8112-456e-bc6c-37a7dc165b7f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:23.602699 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-91ed08dd-8112-456e-bc6c-37a7dc165b7f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1364 microversion: 2.1 time: 0.146538 Jun 16 19:01:23.603304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 351/735] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:23 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:23.772898 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5b8c8a77-a502-4a83-9986-e48f17037997 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:23.772898 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5b8c8a77-a502-4a83-9986-e48f17037997 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:23.778299 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5b8c8a77-a502-4a83-9986-e48f17037997 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:23.778742 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5b8c8a77-a502-4a83-9986-e48f17037997 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:23.779508 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5b8c8a77-a502-4a83-9986-e48f17037997 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:23.779946 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5b8c8a77-a502-4a83-9986-e48f17037997 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:23.997692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5b8c8a77-a502-4a83-9986-e48f17037997 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:24.005267 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5b8c8a77-a502-4a83-9986-e48f17037997 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1568 microversion: 2.1 time: 0.237668 Jun 16 19:01:24.005823 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 385/736] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:23 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:24.354936 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-03593399-421d-4028-bea2-4d387bed8dd0 req-17a7e8f2-ba00-45be-879c-2a41c849911a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33ad0030-d602-4eda-932c-e5a9ff1a7339", "name": "network-vif-plugged", "status": "completed", "tag": "876dcbc0-6957-426a-86fc-525cbbd501e9"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:24.367666 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=10 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:24.371926 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-03593399-421d-4028-bea2-4d387bed8dd0 req-17a7e8f2-ba00-45be-879c-2a41c849911a service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:24.372390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-03593399-421d-4028-bea2-4d387bed8dd0 req-17a7e8f2-ba00-45be-879c-2a41c849911a service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:24.383913 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-03593399-421d-4028-bea2-4d387bed8dd0 req-17a7e8f2-ba00-45be-879c-2a41c849911a service nova] Creating event network-vif-plugged:876dcbc0-6957-426a-86fc-525cbbd501e9 for instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 on hv-cinder-84617 Jun 16 19:01:24.389047 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-03593399-421d-4028-bea2-4d387bed8dd0 req-17a7e8f2-ba00-45be-879c-2a41c849911a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040517 Jun 16 19:01:24.389692 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 352/737] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:24.497698 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8baf35c3-7bb1-49e7-8eeb-5b64a1db2c24 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:24.498551 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8baf35c3-7bb1-49e7-8eeb-5b64a1db2c24 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:24.505361 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8baf35c3-7bb1-49e7-8eeb-5b64a1db2c24 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:24.505889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8baf35c3-7bb1-49e7-8eeb-5b64a1db2c24 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:24.506994 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8baf35c3-7bb1-49e7-8eeb-5b64a1db2c24 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:24.507510 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8baf35c3-7bb1-49e7-8eeb-5b64a1db2c24 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:24.620097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-95628641-8600-48f2-bfff-c51e43790a28 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:24.620808 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-95628641-8600-48f2-bfff-c51e43790a28 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:24.627142 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-95628641-8600-48f2-bfff-c51e43790a28 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:24.627946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-95628641-8600-48f2-bfff-c51e43790a28 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:24.628746 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-95628641-8600-48f2-bfff-c51e43790a28 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:24.629175 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-95628641-8600-48f2-bfff-c51e43790a28 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:24.702925 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8baf35c3-7bb1-49e7-8eeb-5b64a1db2c24 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:24.711150 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8baf35c3-7bb1-49e7-8eeb-5b64a1db2c24 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:24.713388 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8baf35c3-7bb1-49e7-8eeb-5b64a1db2c24 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:24.713984 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8baf35c3-7bb1-49e7-8eeb-5b64a1db2c24 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1405 microversion: 2.20 time: 0.220408 Jun 16 19:01:24.714548 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 386/738] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:24 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:24.792594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-95628641-8600-48f2-bfff-c51e43790a28 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:24.799981 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-95628641-8600-48f2-bfff-c51e43790a28 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1364 microversion: 2.1 time: 0.184355 Jun 16 19:01:24.800539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 353/739] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:24 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:25.023202 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f77112a5-30e9-419e-8f24-9ed1f6d08ca2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:25.023857 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f77112a5-30e9-419e-8f24-9ed1f6d08ca2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:25.030444 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f77112a5-30e9-419e-8f24-9ed1f6d08ca2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:25.030898 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f77112a5-30e9-419e-8f24-9ed1f6d08ca2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:25.031994 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f77112a5-30e9-419e-8f24-9ed1f6d08ca2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:25.032494 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f77112a5-30e9-419e-8f24-9ed1f6d08ca2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:25.161267 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f77112a5-30e9-419e-8f24-9ed1f6d08ca2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:25.168780 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f77112a5-30e9-419e-8f24-9ed1f6d08ca2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1568 microversion: 2.1 time: 0.150124 Jun 16 19:01:25.169366 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 387/740] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:25 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:25.732685 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-59367db1-63e2-4212-99f8-4ff9e475323c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:25.733347 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-59367db1-63e2-4212-99f8-4ff9e475323c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:25.740011 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-59367db1-63e2-4212-99f8-4ff9e475323c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:25.740501 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-59367db1-63e2-4212-99f8-4ff9e475323c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:25.741295 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-59367db1-63e2-4212-99f8-4ff9e475323c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:25.741740 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-59367db1-63e2-4212-99f8-4ff9e475323c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:25.816774 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-871770ea-a528-4319-a2c0-b015a8b4e383 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:25.817347 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-871770ea-a528-4319-a2c0-b015a8b4e383 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:25.823765 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-871770ea-a528-4319-a2c0-b015a8b4e383 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:25.824216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-871770ea-a528-4319-a2c0-b015a8b4e383 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:25.824990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-871770ea-a528-4319-a2c0-b015a8b4e383 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:25.826023 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-871770ea-a528-4319-a2c0-b015a8b4e383 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:25.841652 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=100 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:25.899564 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-59367db1-63e2-4212-99f8-4ff9e475323c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:25.908647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-59367db1-63e2-4212-99f8-4ff9e475323c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:25.919292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-59367db1-63e2-4212-99f8-4ff9e475323c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:25.919292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-59367db1-63e2-4212-99f8-4ff9e475323c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1405 microversion: 2.20 time: 0.183117 Jun 16 19:01:25.919292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 354/741] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:25 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:25.967733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-871770ea-a528-4319-a2c0-b015a8b4e383 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:25.975434 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-871770ea-a528-4319-a2c0-b015a8b4e383 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1364 microversion: 2.1 time: 0.162687 Jun 16 19:01:25.976733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 388/742] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:25 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:26.186473 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f120e01a-45c0-4443-adb6-b8ee4ac253c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:26.187090 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f120e01a-45c0-4443-adb6-b8ee4ac253c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:26.193259 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f120e01a-45c0-4443-adb6-b8ee4ac253c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:26.193713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f120e01a-45c0-4443-adb6-b8ee4ac253c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:26.194476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f120e01a-45c0-4443-adb6-b8ee4ac253c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:26.194934 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f120e01a-45c0-4443-adb6-b8ee4ac253c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:26.322064 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f120e01a-45c0-4443-adb6-b8ee4ac253c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:26.329637 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f120e01a-45c0-4443-adb6-b8ee4ac253c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1569 microversion: 2.1 time: 0.147658 Jun 16 19:01:26.330202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 355/743] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:26 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:26.348230 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7c176e80-3a04-4792-8ea7-4de0a3da600f tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:26.348810 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7c176e80-3a04-4792-8ea7-4de0a3da600f tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:26.355674 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c176e80-3a04-4792-8ea7-4de0a3da600f tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:26.356126 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c176e80-3a04-4792-8ea7-4de0a3da600f tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:26.357548 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c176e80-3a04-4792-8ea7-4de0a3da600f tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:26.357992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7c176e80-3a04-4792-8ea7-4de0a3da600f tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:26.544289 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7c176e80-3a04-4792-8ea7-4de0a3da600f tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "POST /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18/action" status: 202 len: 0 microversion: 2.1 time: 0.199825 Jun 16 19:01:26.545352 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 389/744] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jun 16 19:01:26 2022] POST /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:01:26.553492 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-29f776c2-23f5-4c71-976c-71cb83e75905 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:26.554113 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-29f776c2-23f5-4c71-976c-71cb83e75905 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:26.560129 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29f776c2-23f5-4c71-976c-71cb83e75905 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:26.560584 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29f776c2-23f5-4c71-976c-71cb83e75905 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:26.561389 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29f776c2-23f5-4c71-976c-71cb83e75905 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:26.561833 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29f776c2-23f5-4c71-976c-71cb83e75905 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:26.697588 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-29f776c2-23f5-4c71-976c-71cb83e75905 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:26.706785 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-29f776c2-23f5-4c71-976c-71cb83e75905 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1577 microversion: 2.1 time: 0.157168 Jun 16 19:01:26.716814 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 356/745] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:26 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:26.929721 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-07902bee-e655-4a99-a674-54d407ba9774 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:26.930484 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-07902bee-e655-4a99-a674-54d407ba9774 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:26.936647 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-07902bee-e655-4a99-a674-54d407ba9774 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:26.937090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-07902bee-e655-4a99-a674-54d407ba9774 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:26.937876 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-07902bee-e655-4a99-a674-54d407ba9774 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:26.938310 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-07902bee-e655-4a99-a674-54d407ba9774 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:26.994795 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d78747cb-344a-4104-a685-4918973061aa tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:26.995408 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d78747cb-344a-4104-a685-4918973061aa tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:27.002013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d78747cb-344a-4104-a685-4918973061aa tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:27.002461 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d78747cb-344a-4104-a685-4918973061aa tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:27.003232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d78747cb-344a-4104-a685-4918973061aa tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:27.003668 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d78747cb-344a-4104-a685-4918973061aa tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:27.172638 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-07902bee-e655-4a99-a674-54d407ba9774 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:27.181880 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-07902bee-e655-4a99-a674-54d407ba9774 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:27.183587 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-07902bee-e655-4a99-a674-54d407ba9774 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:27.184767 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-07902bee-e655-4a99-a674-54d407ba9774 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1597 microversion: 2.20 time: 0.258937 Jun 16 19:01:27.185886 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 390/746] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:26 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1597 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:27.196020 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d78747cb-344a-4104-a685-4918973061aa tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:27.205479 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3595d58a-b9e1-424f-b9ea-165afb55d2df tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:27.205479 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3595d58a-b9e1-424f-b9ea-165afb55d2df tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:27.206837 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d78747cb-344a-4104-a685-4918973061aa tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1364 microversion: 2.1 time: 0.216163 Jun 16 19:01:27.207411 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 357/747] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:26 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:27.210413 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3595d58a-b9e1-424f-b9ea-165afb55d2df tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:27.210868 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3595d58a-b9e1-424f-b9ea-165afb55d2df tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:27.211638 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3595d58a-b9e1-424f-b9ea-165afb55d2df tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:27.212257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3595d58a-b9e1-424f-b9ea-165afb55d2df tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:27.295062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3595d58a-b9e1-424f-b9ea-165afb55d2df tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096023 Jun 16 19:01:27.295652 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 391/748] 10.222.0.81 () {60 vars in 1315 bytes} [Thu Jun 16 19:01:27 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:01:27.724233 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-72135817-283a-4160-94fd-f4c8aa06e3a3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:27.724857 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-72135817-283a-4160-94fd-f4c8aa06e3a3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:27.731262 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-72135817-283a-4160-94fd-f4c8aa06e3a3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:27.731716 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-72135817-283a-4160-94fd-f4c8aa06e3a3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:27.733001 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-72135817-283a-4160-94fd-f4c8aa06e3a3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:27.733469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-72135817-283a-4160-94fd-f4c8aa06e3a3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:28.074118 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-72135817-283a-4160-94fd-f4c8aa06e3a3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:28.081777 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-72135817-283a-4160-94fd-f4c8aa06e3a3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1517 microversion: 2.1 time: 0.361598 Jun 16 19:01:28.082499 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 358/749] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:27 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1517 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:28.221556 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=4 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:28.222388 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=14 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:28.226708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3ca7c1e3-9857-4639-a7ae-c5e073dda63b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:28.227269 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3ca7c1e3-9857-4639-a7ae-c5e073dda63b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:28.233595 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3ca7c1e3-9857-4639-a7ae-c5e073dda63b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:28.234052 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3ca7c1e3-9857-4639-a7ae-c5e073dda63b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:28.234856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3ca7c1e3-9857-4639-a7ae-c5e073dda63b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:28.235301 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3ca7c1e3-9857-4639-a7ae-c5e073dda63b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:28.338928 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-9c0267e6-56dd-4e25-aefc-c6a35e3eb7e7 req-553747e7-1ac6-4e57-a9a9-02bf80cec504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf1ba63-bf52-412b-9948-409dadbbdf18", "name": "network-vif-unplugged", "status": "completed", "tag": "9d682d40-5577-43db-823b-b6e4729f33b7"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:28.352201 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-9c0267e6-56dd-4e25-aefc-c6a35e3eb7e7 req-553747e7-1ac6-4e57-a9a9-02bf80cec504 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:28.353056 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-9c0267e6-56dd-4e25-aefc-c6a35e3eb7e7 req-553747e7-1ac6-4e57-a9a9-02bf80cec504 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:28.368147 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.compute.server_external_events [req-9c0267e6-56dd-4e25-aefc-c6a35e3eb7e7 req-553747e7-1ac6-4e57-a9a9-02bf80cec504 service nova] Unable to find a host for instance 5bf1ba63-bf52-412b-9948-409dadbbdf18. Dropping event network-vif-unplugged {{(pid=130230) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 19:01:28.369649 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-9c0267e6-56dd-4e25-aefc-c6a35e3eb7e7 req-553747e7-1ac6-4e57-a9a9-02bf80cec504 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034861 Jun 16 19:01:28.372875 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 359/750] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 16 19:01:28.476096 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3ca7c1e3-9857-4639-a7ae-c5e073dda63b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:28.488805 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3ca7c1e3-9857-4639-a7ae-c5e073dda63b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1364 microversion: 2.1 time: 0.264056 Jun 16 19:01:28.492496 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 392/751] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:28 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:28.764345 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-2ddcd28b-b8b0-430d-97d8-a4606d9dba0c req-426ec32e-aec0-4e56-b6ad-28a7afd25604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33ad0030-d602-4eda-932c-e5a9ff1a7339", "tag": "876dcbc0-6957-426a-86fc-525cbbd501e9"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:28.773602 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-2ddcd28b-b8b0-430d-97d8-a4606d9dba0c req-426ec32e-aec0-4e56-b6ad-28a7afd25604 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:28.774385 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-2ddcd28b-b8b0-430d-97d8-a4606d9dba0c req-426ec32e-aec0-4e56-b6ad-28a7afd25604 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:28.787751 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-2ddcd28b-b8b0-430d-97d8-a4606d9dba0c req-426ec32e-aec0-4e56-b6ad-28a7afd25604 service nova] Creating event network-changed:876dcbc0-6957-426a-86fc-525cbbd501e9 for instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 on hv-cinder-84617 Jun 16 19:01:28.793340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-2ddcd28b-b8b0-430d-97d8-a4606d9dba0c req-426ec32e-aec0-4e56-b6ad-28a7afd25604 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095062 Jun 16 19:01:28.794242 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 360/752] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:29.101353 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1c3590d2-f8b8-4324-9afd-8e5efe8f70c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:29.102076 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-1c3590d2-f8b8-4324-9afd-8e5efe8f70c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:29.109285 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1c3590d2-f8b8-4324-9afd-8e5efe8f70c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:29.114432 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1c3590d2-f8b8-4324-9afd-8e5efe8f70c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:29.114432 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1c3590d2-f8b8-4324-9afd-8e5efe8f70c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:29.114432 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1c3590d2-f8b8-4324-9afd-8e5efe8f70c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:29.314528 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1c3590d2-f8b8-4324-9afd-8e5efe8f70c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:29.323386 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-1c3590d2-f8b8-4324-9afd-8e5efe8f70c9 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1519 microversion: 2.1 time: 0.227550 Jun 16 19:01:29.324265 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 393/753] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:29 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1519 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:29.501939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1d7cfe24-30dc-4425-a080-dd95b3f355d1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:29.504155 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1d7cfe24-30dc-4425-a080-dd95b3f355d1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:29.513351 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1d7cfe24-30dc-4425-a080-dd95b3f355d1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:29.513967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1d7cfe24-30dc-4425-a080-dd95b3f355d1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:29.515479 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1d7cfe24-30dc-4425-a080-dd95b3f355d1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:29.516020 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1d7cfe24-30dc-4425-a080-dd95b3f355d1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:29.811708 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1d7cfe24-30dc-4425-a080-dd95b3f355d1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:29.820088 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1d7cfe24-30dc-4425-a080-dd95b3f355d1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1364 microversion: 2.1 time: 0.323259 Jun 16 19:01:29.832088 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 361/754] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:29 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1364 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:29.889774 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-37cc743d-991d-45bf-bd9d-9e95999b7fb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:29.890401 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-37cc743d-991d-45bf-bd9d-9e95999b7fb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:29.903735 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-37cc743d-991d-45bf-bd9d-9e95999b7fb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:29.904218 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-37cc743d-991d-45bf-bd9d-9e95999b7fb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:29.905618 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-37cc743d-991d-45bf-bd9d-9e95999b7fb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:29.907472 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-37cc743d-991d-45bf-bd9d-9e95999b7fb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:30.001865 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-37cc743d-991d-45bf-bd9d-9e95999b7fb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lazy-loading 'services' on Instance uuid 88123824-1b55-41ca-a29f-0d3e0edd3d1d {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:01:30.239792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-37cc743d-991d-45bf-bd9d-9e95999b7fb7 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "DELETE /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-volume_attachments/40b69ccd-6cbe-4c7d-aab0-a69290a51494" status: 202 len: 0 microversion: 2.1 time: 0.355043 Jun 16 19:01:30.240434 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 394/755] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jun 16 19:01:29 2022] DELETE /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-volume_attachments/40b69ccd-6cbe-4c7d-aab0-a69290a51494 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:01:30.249529 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-780fa974-5673-419d-b74a-00b1594cdac2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:30.250473 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-780fa974-5673-419d-b74a-00b1594cdac2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:30.256470 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-780fa974-5673-419d-b74a-00b1594cdac2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:30.256923 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-780fa974-5673-419d-b74a-00b1594cdac2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:30.257736 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-780fa974-5673-419d-b74a-00b1594cdac2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:30.258181 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-780fa974-5673-419d-b74a-00b1594cdac2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:30.287601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-780fa974-5673-419d-b74a-00b1594cdac2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042535 Jun 16 19:01:30.288262 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 362/756] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:01:30 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:30.341081 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a79cd41a-1a2c-4a25-b855-62d0013fa148 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:30.342037 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a79cd41a-1a2c-4a25-b855-62d0013fa148 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:30.344069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:30.349361 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a79cd41a-1a2c-4a25-b855-62d0013fa148 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:30.349878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a79cd41a-1a2c-4a25-b855-62d0013fa148 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:30.350862 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a79cd41a-1a2c-4a25-b855-62d0013fa148 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:30.351300 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a79cd41a-1a2c-4a25-b855-62d0013fa148 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:30.386903 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-eacb93ba-e096-48c8-9b28-dcbde736169e req-76387cae-a835-493e-9f8e-1dcd31f186fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "effe0963-698f-48d6-adf3-6b53bf88e09c", "name": "network-vif-plugged", "status": "completed", "tag": "883851d6-ca58-4dd2-9dcf-af84a9421688"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:30.396086 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-eacb93ba-e096-48c8-9b28-dcbde736169e req-76387cae-a835-493e-9f8e-1dcd31f186fa service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:30.396531 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-eacb93ba-e096-48c8-9b28-dcbde736169e req-76387cae-a835-493e-9f8e-1dcd31f186fa service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:30.407721 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-eacb93ba-e096-48c8-9b28-dcbde736169e req-76387cae-a835-493e-9f8e-1dcd31f186fa service nova] Creating event network-vif-plugged:883851d6-ca58-4dd2-9dcf-af84a9421688 for instance effe0963-698f-48d6-adf3-6b53bf88e09c on hv-cinder-84617 Jun 16 19:01:30.412468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-eacb93ba-e096-48c8-9b28-dcbde736169e req-76387cae-a835-493e-9f8e-1dcd31f186fa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029294 Jun 16 19:01:30.413064 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 363/757] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:01:30.495018 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a79cd41a-1a2c-4a25-b855-62d0013fa148 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:30.503049 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a79cd41a-1a2c-4a25-b855-62d0013fa148 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1575 microversion: 2.1 time: 0.166309 Jun 16 19:01:30.503615 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 395/758] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:30 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:30.839615 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4bb3463a-6af1-42ff-afe3-8af1e46793b1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:30.840322 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4bb3463a-6af1-42ff-afe3-8af1e46793b1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:30.847104 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4bb3463a-6af1-42ff-afe3-8af1e46793b1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:30.847494 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4bb3463a-6af1-42ff-afe3-8af1e46793b1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:30.848261 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4bb3463a-6af1-42ff-afe3-8af1e46793b1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:30.848730 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4bb3463a-6af1-42ff-afe3-8af1e46793b1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:31.008141 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4bb3463a-6af1-42ff-afe3-8af1e46793b1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:31.015553 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4bb3463a-6af1-42ff-afe3-8af1e46793b1 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1364 microversion: 2.1 time: 0.180682 Jun 16 19:01:31.016122 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 364/759] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:30 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:31.298759 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-66393725-7d2d-4bba-b46a-e5498e5d8eab tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:31.299674 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-66393725-7d2d-4bba-b46a-e5498e5d8eab tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:31.306158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-66393725-7d2d-4bba-b46a-e5498e5d8eab tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:31.306608 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-66393725-7d2d-4bba-b46a-e5498e5d8eab tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:31.307365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-66393725-7d2d-4bba-b46a-e5498e5d8eab tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:31.307801 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-66393725-7d2d-4bba-b46a-e5498e5d8eab tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:31.337752 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-66393725-7d2d-4bba-b46a-e5498e5d8eab tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042992 Jun 16 19:01:31.338305 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 396/760] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:01:31 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:31.520416 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3d14c4eb-7bbf-47d8-b6a6-83a6b027ba91 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:31.521030 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3d14c4eb-7bbf-47d8-b6a6-83a6b027ba91 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:31.527108 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3d14c4eb-7bbf-47d8-b6a6-83a6b027ba91 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:31.527558 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3d14c4eb-7bbf-47d8-b6a6-83a6b027ba91 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:31.528327 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3d14c4eb-7bbf-47d8-b6a6-83a6b027ba91 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:31.528758 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3d14c4eb-7bbf-47d8-b6a6-83a6b027ba91 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:31.660847 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-3d14c4eb-7bbf-47d8-b6a6-83a6b027ba91 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:31.668293 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3d14c4eb-7bbf-47d8-b6a6-83a6b027ba91 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1575 microversion: 2.1 time: 0.151872 Jun 16 19:01:31.668857 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 365/761] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:31 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:32.032159 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a2fe6140-6187-40db-8d12-76f3bcb8484b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:32.032838 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a2fe6140-6187-40db-8d12-76f3bcb8484b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:32.039208 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a2fe6140-6187-40db-8d12-76f3bcb8484b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:32.039658 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a2fe6140-6187-40db-8d12-76f3bcb8484b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:32.040421 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a2fe6140-6187-40db-8d12-76f3bcb8484b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:32.040859 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a2fe6140-6187-40db-8d12-76f3bcb8484b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:32.169087 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a2fe6140-6187-40db-8d12-76f3bcb8484b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:32.176901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a2fe6140-6187-40db-8d12-76f3bcb8484b tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1364 microversion: 2.1 time: 0.148832 Jun 16 19:01:32.177478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 397/762] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:32 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:32.349371 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b84efb7d-fe34-46ab-9680-211609e9bc79 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:32.350362 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b84efb7d-fe34-46ab-9680-211609e9bc79 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:32.356853 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b84efb7d-fe34-46ab-9680-211609e9bc79 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:32.357339 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b84efb7d-fe34-46ab-9680-211609e9bc79 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:32.358660 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b84efb7d-fe34-46ab-9680-211609e9bc79 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:32.359098 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b84efb7d-fe34-46ab-9680-211609e9bc79 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:32.387891 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b84efb7d-fe34-46ab-9680-211609e9bc79 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042485 Jun 16 19:01:32.388449 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 366/763] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:01:32 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:01:32.468177 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-825d0a4e-d3bc-4dcd-a176-2fce4df6bd3e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:32.468671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-825d0a4e-d3bc-4dcd-a176-2fce4df6bd3e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:32.475080 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-825d0a4e-d3bc-4dcd-a176-2fce4df6bd3e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:32.475522 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-825d0a4e-d3bc-4dcd-a176-2fce4df6bd3e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:32.476277 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-825d0a4e-d3bc-4dcd-a176-2fce4df6bd3e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:32.476706 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-825d0a4e-d3bc-4dcd-a176-2fce4df6bd3e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:32.501798 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-825d0a4e-d3bc-4dcd-a176-2fce4df6bd3e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Going to try to terminate instance {{(pid=130229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:01:32.685214 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-210a1369-1e6e-405d-aa1d-616eeef9a56f tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:32.685980 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-210a1369-1e6e-405d-aa1d-616eeef9a56f tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:32.693899 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-210a1369-1e6e-405d-aa1d-616eeef9a56f tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:32.694576 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-210a1369-1e6e-405d-aa1d-616eeef9a56f tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:32.695710 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-210a1369-1e6e-405d-aa1d-616eeef9a56f tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:32.696418 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-210a1369-1e6e-405d-aa1d-616eeef9a56f tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:32.778011 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-825d0a4e-d3bc-4dcd-a176-2fce4df6bd3e tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "DELETE /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 204 len: 0 microversion: 2.1 time: 0.313803 Jun 16 19:01:32.778610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 398/764] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:01:32 2022] DELETE /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:01:32.788106 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-139f9029-f23b-4165-822f-0bf96963e0e2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:32.788812 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-139f9029-f23b-4165-822f-0bf96963e0e2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:32.796835 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-139f9029-f23b-4165-822f-0bf96963e0e2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:32.797297 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-139f9029-f23b-4165-822f-0bf96963e0e2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:32.798075 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-139f9029-f23b-4165-822f-0bf96963e0e2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:32.798511 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-139f9029-f23b-4165-822f-0bf96963e0e2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:32.845685 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-210a1369-1e6e-405d-aa1d-616eeef9a56f tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:32.855523 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-210a1369-1e6e-405d-aa1d-616eeef9a56f tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1575 microversion: 2.1 time: 0.174232 Jun 16 19:01:32.856096 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 367/765] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:32 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:32.932446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-139f9029-f23b-4165-822f-0bf96963e0e2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:32.939895 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-139f9029-f23b-4165-822f-0bf96963e0e2 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1687 microversion: 2.1 time: 0.156067 Jun 16 19:01:32.940390 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 399/766] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:32 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:33.194381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-02e37b63-12b9-46eb-a1fa-94bc476f5367 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:33.194918 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-02e37b63-12b9-46eb-a1fa-94bc476f5367 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:33.200914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-02e37b63-12b9-46eb-a1fa-94bc476f5367 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:33.201396 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-02e37b63-12b9-46eb-a1fa-94bc476f5367 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:33.202766 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-02e37b63-12b9-46eb-a1fa-94bc476f5367 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:33.203200 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-02e37b63-12b9-46eb-a1fa-94bc476f5367 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:33.332842 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-02e37b63-12b9-46eb-a1fa-94bc476f5367 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:33.340237 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-02e37b63-12b9-46eb-a1fa-94bc476f5367 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1549 microversion: 2.1 time: 0.149874 Jun 16 19:01:33.340801 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 368/767] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:33 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:33.356187 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b6853d54-ae8e-461a-b08a-5991c4d24810 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:33.356738 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b6853d54-ae8e-461a-b08a-5991c4d24810 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:33.362843 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b6853d54-ae8e-461a-b08a-5991c4d24810 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:33.363294 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b6853d54-ae8e-461a-b08a-5991c4d24810 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:33.364066 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b6853d54-ae8e-461a-b08a-5991c4d24810 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:33.364507 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b6853d54-ae8e-461a-b08a-5991c4d24810 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:33.439684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b6853d54-ae8e-461a-b08a-5991c4d24810 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087397 Jun 16 19:01:33.440269 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 400/768] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jun 16 19:01:33 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:33.872463 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-7c96c7f3-1045-465d-9834-20e6024bca71 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:33.873110 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-7c96c7f3-1045-465d-9834-20e6024bca71 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:33.879653 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7c96c7f3-1045-465d-9834-20e6024bca71 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:33.880101 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7c96c7f3-1045-465d-9834-20e6024bca71 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:33.880872 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7c96c7f3-1045-465d-9834-20e6024bca71 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:33.881338 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7c96c7f3-1045-465d-9834-20e6024bca71 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:33.885466 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=100 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:33.956570 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5e7a6996-d0a2-4b81-8f1a-6df5ec525a97 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:33.957380 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5e7a6996-d0a2-4b81-8f1a-6df5ec525a97 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:33.964682 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5e7a6996-d0a2-4b81-8f1a-6df5ec525a97 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:33.965207 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5e7a6996-d0a2-4b81-8f1a-6df5ec525a97 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:33.966198 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5e7a6996-d0a2-4b81-8f1a-6df5ec525a97 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:33.966786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5e7a6996-d0a2-4b81-8f1a-6df5ec525a97 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:34.148176 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-7c96c7f3-1045-465d-9834-20e6024bca71 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:34.156426 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-7c96c7f3-1045-465d-9834-20e6024bca71 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1575 microversion: 2.1 time: 0.288168 Jun 16 19:01:34.157130 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 369/769] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:33 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1575 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:34.227723 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5e7a6996-d0a2-4b81-8f1a-6df5ec525a97 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:34.235129 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5e7a6996-d0a2-4b81-8f1a-6df5ec525a97 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1687 microversion: 2.1 time: 0.283147 Jun 16 19:01:34.235697 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 401/770] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:33 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1687 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:34.746889 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-37e422f0-eaa0-48e9-87d9-612106432d00 req-672468e0-6a2f-40a0-96ed-cdb2af255724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "effe0963-698f-48d6-adf3-6b53bf88e09c", "tag": "883851d6-ca58-4dd2-9dcf-af84a9421688"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:34.755721 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-37e422f0-eaa0-48e9-87d9-612106432d00 req-672468e0-6a2f-40a0-96ed-cdb2af255724 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:34.756242 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-37e422f0-eaa0-48e9-87d9-612106432d00 req-672468e0-6a2f-40a0-96ed-cdb2af255724 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:34.767590 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-37e422f0-eaa0-48e9-87d9-612106432d00 req-672468e0-6a2f-40a0-96ed-cdb2af255724 service nova] Creating event network-changed:883851d6-ca58-4dd2-9dcf-af84a9421688 for instance effe0963-698f-48d6-adf3-6b53bf88e09c on hv-cinder-84617 Jun 16 19:01:34.772634 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-37e422f0-eaa0-48e9-87d9-612106432d00 req-672468e0-6a2f-40a0-96ed-cdb2af255724 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029664 Jun 16 19:01:34.773330 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 370/771] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:35.173446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6e8d6035-6853-402a-976c-a85ce52b1fd3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:35.174074 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6e8d6035-6853-402a-976c-a85ce52b1fd3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:35.180486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6e8d6035-6853-402a-976c-a85ce52b1fd3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:35.180941 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6e8d6035-6853-402a-976c-a85ce52b1fd3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:35.181719 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6e8d6035-6853-402a-976c-a85ce52b1fd3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:35.182155 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6e8d6035-6853-402a-976c-a85ce52b1fd3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:35.197267 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:35.253420 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b317fca6-8bec-4076-b0a5-6715623483ce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:35.254124 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b317fca6-8bec-4076-b0a5-6715623483ce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:35.260541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b317fca6-8bec-4076-b0a5-6715623483ce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:35.261473 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b317fca6-8bec-4076-b0a5-6715623483ce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:35.262248 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b317fca6-8bec-4076-b0a5-6715623483ce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:35.262684 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b317fca6-8bec-4076-b0a5-6715623483ce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:35.350724 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6e8d6035-6853-402a-976c-a85ce52b1fd3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:35.359613 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6e8d6035-6853-402a-976c-a85ce52b1fd3 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1575 microversion: 2.1 time: 0.190559 Jun 16 19:01:35.369660 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 402/772] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:35 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:35.413846 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b317fca6-8bec-4076-b0a5-6715623483ce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:35.422280 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b317fca6-8bec-4076-b0a5-6715623483ce tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1687 microversion: 2.1 time: 0.174113 Jun 16 19:01:35.422857 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 371/773] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:35 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:36.376484 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f100a0ac-b980-4ab0-becc-7b2190ac5324 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:36.377090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f100a0ac-b980-4ab0-becc-7b2190ac5324 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:36.383563 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f100a0ac-b980-4ab0-becc-7b2190ac5324 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:36.384004 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f100a0ac-b980-4ab0-becc-7b2190ac5324 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:36.384785 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f100a0ac-b980-4ab0-becc-7b2190ac5324 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:36.385217 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f100a0ac-b980-4ab0-becc-7b2190ac5324 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:36.439988 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1030b050-b988-4254-ab9e-2f11516a6b82 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:36.440604 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1030b050-b988-4254-ab9e-2f11516a6b82 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:36.447344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1030b050-b988-4254-ab9e-2f11516a6b82 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:36.447795 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1030b050-b988-4254-ab9e-2f11516a6b82 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:36.448570 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1030b050-b988-4254-ab9e-2f11516a6b82 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:36.449008 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1030b050-b988-4254-ab9e-2f11516a6b82 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:36.553837 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f100a0ac-b980-4ab0-becc-7b2190ac5324 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:36.562001 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f100a0ac-b980-4ab0-becc-7b2190ac5324 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1575 microversion: 2.1 time: 0.189233 Jun 16 19:01:36.562579 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 403/774] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:36 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:36.600248 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1030b050-b988-4254-ab9e-2f11516a6b82 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:36.607750 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1030b050-b988-4254-ab9e-2f11516a6b82 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1687 microversion: 2.1 time: 0.172196 Jun 16 19:01:36.608829 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 372/775] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:36 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:37.579092 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f1e98fac-c1e9-4e42-9d8a-8a4c92e6a07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:37.579853 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f1e98fac-c1e9-4e42-9d8a-8a4c92e6a07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:37.586458 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f1e98fac-c1e9-4e42-9d8a-8a4c92e6a07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:37.586899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f1e98fac-c1e9-4e42-9d8a-8a4c92e6a07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:37.587662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f1e98fac-c1e9-4e42-9d8a-8a4c92e6a07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:37.588181 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f1e98fac-c1e9-4e42-9d8a-8a4c92e6a07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:37.624460 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-514bbb3c-2479-416a-acf1-09b49c7cf3c0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:37.625123 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-514bbb3c-2479-416a-acf1-09b49c7cf3c0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:37.631570 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-514bbb3c-2479-416a-acf1-09b49c7cf3c0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:37.632012 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-514bbb3c-2479-416a-acf1-09b49c7cf3c0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:37.632776 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-514bbb3c-2479-416a-acf1-09b49c7cf3c0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:37.633199 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-514bbb3c-2479-416a-acf1-09b49c7cf3c0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:37.889201 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f1e98fac-c1e9-4e42-9d8a-8a4c92e6a07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:37.897157 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f1e98fac-c1e9-4e42-9d8a-8a4c92e6a07a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1575 microversion: 2.1 time: 0.321996 Jun 16 19:01:37.897754 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 404/776] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:37 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1575 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:37.901933 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-514bbb3c-2479-416a-acf1-09b49c7cf3c0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:37.909893 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-514bbb3c-2479-416a-acf1-09b49c7cf3c0 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1687 microversion: 2.1 time: 0.289158 Jun 16 19:01:37.911388 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 373/777] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:37 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1687 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:38.280408 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-9b2318ae-2b3b-427e-83c3-c5a0b996ed12 req-fb100742-aa52-4893-8996-b921328cb9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88123824-1b55-41ca-a29f-0d3e0edd3d1d", "name": "network-vif-deleted", "tag": "2fb01582-cf21-44de-8d3e-18570d242041"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:38.291102 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-9b2318ae-2b3b-427e-83c3-c5a0b996ed12 req-fb100742-aa52-4893-8996-b921328cb9d4 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:38.291559 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-9b2318ae-2b3b-427e-83c3-c5a0b996ed12 req-fb100742-aa52-4893-8996-b921328cb9d4 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:38.302954 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-9b2318ae-2b3b-427e-83c3-c5a0b996ed12 req-fb100742-aa52-4893-8996-b921328cb9d4 service nova] Creating event network-vif-deleted:2fb01582-cf21-44de-8d3e-18570d242041 for instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d on hv-cinder-84617 Jun 16 19:01:38.308360 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-9b2318ae-2b3b-427e-83c3-c5a0b996ed12 req-fb100742-aa52-4893-8996-b921328cb9d4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031766 Jun 16 19:01:38.309483 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 405/778] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:38.918641 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e53ff3a4-14ff-4bce-a399-7be055498cb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:38.919801 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e53ff3a4-14ff-4bce-a399-7be055498cb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:38.927038 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a70f85f2-7b0b-4605-b476-b61fbe644080 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:38.927740 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a70f85f2-7b0b-4605-b476-b61fbe644080 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:38.929914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e53ff3a4-14ff-4bce-a399-7be055498cb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:38.930538 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e53ff3a4-14ff-4bce-a399-7be055498cb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:38.937772 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e53ff3a4-14ff-4bce-a399-7be055498cb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:38.938802 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e53ff3a4-14ff-4bce-a399-7be055498cb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:38.941960 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a70f85f2-7b0b-4605-b476-b61fbe644080 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:38.943349 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a70f85f2-7b0b-4605-b476-b61fbe644080 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:38.944789 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a70f85f2-7b0b-4605-b476-b61fbe644080 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:38.945599 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a70f85f2-7b0b-4605-b476-b61fbe644080 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:38.987594 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a70f85f2-7b0b-4605-b476-b61fbe644080 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:38.988093 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a70f85f2-7b0b-4605-b476-b61fbe644080 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:38.988772 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-a70f85f2-7b0b-4605-b476-b61fbe644080 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lazy-loading 'fault' on Instance uuid 88123824-1b55-41ca-a29f-0d3e0edd3d1d {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:01:39.056089 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a70f85f2-7b0b-4605-b476-b61fbe644080 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:39.064541 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a70f85f2-7b0b-4605-b476-b61fbe644080 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 200 len: 1333 microversion: 2.1 time: 0.141574 Jun 16 19:01:39.065123 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 406/779] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:38 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 1333 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:39.131820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e53ff3a4-14ff-4bce-a399-7be055498cb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:39.141072 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e53ff3a4-14ff-4bce-a399-7be055498cb7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1575 microversion: 2.1 time: 0.229520 Jun 16 19:01:39.141915 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 374/780] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:38 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:40.089169 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1a3c0669-f6aa-48b2-991b-0ffd8a81b878 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:40.089732 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-1a3c0669-f6aa-48b2-991b-0ffd8a81b878 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 88123824-1b55-41ca-a29f-0d3e0edd3d1d] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:40.096992 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1a3c0669-f6aa-48b2-991b-0ffd8a81b878 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:40.097650 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1a3c0669-f6aa-48b2-991b-0ffd8a81b878 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:40.102591 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1a3c0669-f6aa-48b2-991b-0ffd8a81b878 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:40.103033 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1a3c0669-f6aa-48b2-991b-0ffd8a81b878 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:40.122119 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-1a3c0669-f6aa-48b2-991b-0ffd8a81b878 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] HTTP exception thrown: Instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d could not be found. Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1a3c0669-f6aa-48b2-991b-0ffd8a81b878 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Request method failure captured: Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d HTTP/1.1 Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq3zGXPpz6QpTlYMAzUwZA2FxpZlcsMj2PZk5Me98X004ESO6iHhtyZi01S2HrA7QRavaFYn_gvj72vUb3j1o8y1FEQDlH2mCzxj0otKQa2G_t9ABiX9PFlgtXlKad4vu-Z7kFV6K2VyP4Foc5kZ5IbGmbuR92aI1zzs_J7gOZWCDPP0 Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: ed8501d1ff734054ba0a6ef4c398d051 Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1664066176 Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:01:40.124292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:01:40.126084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ed8501d1ff734054ba0a6ef4c398d051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ed8501d1ff734054ba0a6ef4c398d051", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ed8501d1ff734054ba0a6ef4c398d051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ed8501d1ff734054ba0a6ef4c398d051"}]}] Jun 16 19:01:40.126084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1664066176 Jun 16 19:01:40.126084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: ed8501d1ff734054ba0a6ef4c398d051 Jun 16 19:01:40.126084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1664066176 Jun 16 19:01:40.126084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-ServerRescueNegativeTestJSON-1664066176-project Jun 16 19:01:40.126084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:01:40.126084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:01:40.126084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 7310c631282c495a83e17dbdbc6d2ba0 Jun 16 19:01:40.126084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1664066176-project Jun 16 19:01:40.126084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:01:40.126084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d could not be found. Jun 16 19:01:40.126084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': '88123824-1b55-41ca-a29f-0d3e0edd3d1d'} Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d could not be found. Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:01:40.127907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d could not be found. Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d could not be found. Jun 16 19:01:40.129384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:01:40.130636 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1a3c0669-f6aa-48b2-991b-0ffd8a81b878 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Returning 404 to user: Instance 88123824-1b55-41ca-a29f-0d3e0edd3d1d could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:01:40.130636 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-1a3c0669-f6aa-48b2-991b-0ffd8a81b878 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d" status: 404 len: 111 microversion: 2.1 time: 0.040574 Jun 16 19:01:40.130636 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 407/781] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:40 2022] GET /compute/v2.1/servers/88123824-1b55-41ca-a29f-0d3e0edd3d1d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:01:40.135103 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f350e496-bb2e-4b31-8495-61204429c95d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '.version_select at 0x7f2007e4ba60>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:40.141396 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:40.158648 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ee7c694b-26d6-4133-afa3-71206795d1b2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:40.159566 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ee7c694b-26d6-4133-afa3-71206795d1b2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:40.165830 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ee7c694b-26d6-4133-afa3-71206795d1b2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:40.166281 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ee7c694b-26d6-4133-afa3-71206795d1b2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:40.167060 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ee7c694b-26d6-4133-afa3-71206795d1b2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:40.167500 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ee7c694b-26d6-4133-afa3-71206795d1b2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:40.226210 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f350e496-bb2e-4b31-8495-61204429c95d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-281560677" status: 202 len: 0 microversion: 2.1 time: 0.094977 Jun 16 19:01:40.227519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 375/782] 10.222.0.81 () {58 vars in 1217 bytes} [Thu Jun 16 19:01:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-281560677 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:01:40.309695 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ee7c694b-26d6-4133-afa3-71206795d1b2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:40.318093 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ee7c694b-26d6-4133-afa3-71206795d1b2 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1575 microversion: 2.1 time: 0.163088 Jun 16 19:01:40.321320 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 408/783] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:40 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:40.367641 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-8c2cd1fc-16d2-4a04-a120-841dca472822 req-644d3636-a801-4a0d-9ef7-56c5770c21ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf1ba63-bf52-412b-9948-409dadbbdf18", "name": "network-vif-plugged", "status": "completed", "tag": "9d682d40-5577-43db-823b-b6e4729f33b7"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:40.379212 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-8c2cd1fc-16d2-4a04-a120-841dca472822 req-644d3636-a801-4a0d-9ef7-56c5770c21ca service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:40.380946 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-8c2cd1fc-16d2-4a04-a120-841dca472822 req-644d3636-a801-4a0d-9ef7-56c5770c21ca service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:40.389996 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-8c2cd1fc-16d2-4a04-a120-841dca472822 req-644d3636-a801-4a0d-9ef7-56c5770c21ca service nova] Creating event network-vif-plugged:9d682d40-5577-43db-823b-b6e4729f33b7 for instance 5bf1ba63-bf52-412b-9948-409dadbbdf18 on hv-cinder-84617 Jun 16 19:01:40.395318 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-8c2cd1fc-16d2-4a04-a120-841dca472822 req-644d3636-a801-4a0d-9ef7-56c5770c21ca service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031669 Jun 16 19:01:40.395971 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 376/784] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:41.335965 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4d6437f8-120c-4a67-8b2f-35df97b7fc1a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:41.336558 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4d6437f8-120c-4a67-8b2f-35df97b7fc1a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:41.343069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d6437f8-120c-4a67-8b2f-35df97b7fc1a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:41.343523 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d6437f8-120c-4a67-8b2f-35df97b7fc1a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:41.344325 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d6437f8-120c-4a67-8b2f-35df97b7fc1a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:41.344761 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d6437f8-120c-4a67-8b2f-35df97b7fc1a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:41.474473 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4d6437f8-120c-4a67-8b2f-35df97b7fc1a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:41.482583 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4d6437f8-120c-4a67-8b2f-35df97b7fc1a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1575 microversion: 2.1 time: 0.150479 Jun 16 19:01:41.483146 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 409/785] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:41 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:42.502605 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e229b7c3-042f-47a0-9eba-3219b43eb077 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:42.502605 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e229b7c3-042f-47a0-9eba-3219b43eb077 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:42.508199 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e229b7c3-042f-47a0-9eba-3219b43eb077 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:42.508625 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e229b7c3-042f-47a0-9eba-3219b43eb077 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:42.509422 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e229b7c3-042f-47a0-9eba-3219b43eb077 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:42.509852 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e229b7c3-042f-47a0-9eba-3219b43eb077 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:42.642378 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e229b7c3-042f-47a0-9eba-3219b43eb077 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:42.649811 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e229b7c3-042f-47a0-9eba-3219b43eb077 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1562 microversion: 2.1 time: 0.153957 Jun 16 19:01:42.650460 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 377/786] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:42 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:43.768698 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b373237a-31d5-41b5-a799-ee74fa098d61 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:43.769230 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b373237a-31d5-41b5-a799-ee74fa098d61 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:43.775732 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b373237a-31d5-41b5-a799-ee74fa098d61 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:43.776179 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b373237a-31d5-41b5-a799-ee74fa098d61 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:43.776937 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b373237a-31d5-41b5-a799-ee74fa098d61 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:43.777410 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b373237a-31d5-41b5-a799-ee74fa098d61 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:43.802638 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b373237a-31d5-41b5-a799-ee74fa098d61 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Going to try to terminate instance {{(pid=130229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:01:44.041567 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b373237a-31d5-41b5-a799-ee74fa098d61 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "DELETE /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 204 len: 0 microversion: 2.1 time: 0.276803 Jun 16 19:01:44.042568 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 410/787] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:01:43 2022] DELETE /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:01:44.052364 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d8347ec5-b89e-43c9-8cf7-218867ae957d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:44.052975 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d8347ec5-b89e-43c9-8cf7-218867ae957d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:44.059727 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d8347ec5-b89e-43c9-8cf7-218867ae957d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:44.060172 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d8347ec5-b89e-43c9-8cf7-218867ae957d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:44.060936 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d8347ec5-b89e-43c9-8cf7-218867ae957d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:44.061500 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d8347ec5-b89e-43c9-8cf7-218867ae957d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:44.192624 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d8347ec5-b89e-43c9-8cf7-218867ae957d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:44.200144 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d8347ec5-b89e-43c9-8cf7-218867ae957d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1507 microversion: 2.1 time: 0.152075 Jun 16 19:01:44.200717 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 378/788] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:44 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:45.217624 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-43b20482-6c60-4048-800e-a7217e4f6ee3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:45.218330 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-43b20482-6c60-4048-800e-a7217e4f6ee3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:45.224743 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-43b20482-6c60-4048-800e-a7217e4f6ee3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:45.225197 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-43b20482-6c60-4048-800e-a7217e4f6ee3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:45.226066 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-43b20482-6c60-4048-800e-a7217e4f6ee3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:45.226540 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-43b20482-6c60-4048-800e-a7217e4f6ee3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:45.353265 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-43b20482-6c60-4048-800e-a7217e4f6ee3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:45.360670 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-43b20482-6c60-4048-800e-a7217e4f6ee3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1507 microversion: 2.1 time: 0.147287 Jun 16 19:01:45.361334 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 411/789] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:45 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:46.303571 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-68d11437-6965-4395-b550-d4b5450506d4 req-c69d5075-6ee5-4217-a555-46e72afac925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410bdd70-d5fd-4cfe-ad04-cf135bef00ff", "name": "network-vif-deleted", "tag": "874e17b1-59b4-455e-93ae-78a55fa69aa1"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:46.312542 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-68d11437-6965-4395-b550-d4b5450506d4 req-c69d5075-6ee5-4217-a555-46e72afac925 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:46.313202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-68d11437-6965-4395-b550-d4b5450506d4 req-c69d5075-6ee5-4217-a555-46e72afac925 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:46.325601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-68d11437-6965-4395-b550-d4b5450506d4 req-c69d5075-6ee5-4217-a555-46e72afac925 service nova] Creating event network-vif-deleted:874e17b1-59b4-455e-93ae-78a55fa69aa1 for instance 410bdd70-d5fd-4cfe-ad04-cf135bef00ff on hv-cinder-84617 Jun 16 19:01:46.330676 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-68d11437-6965-4395-b550-d4b5450506d4 req-c69d5075-6ee5-4217-a555-46e72afac925 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031890 Jun 16 19:01:46.333514 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 379/790] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:46.378829 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b826df68-5bac-4acc-8efe-a7586b67901d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:46.379484 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b826df68-5bac-4acc-8efe-a7586b67901d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:46.386054 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b826df68-5bac-4acc-8efe-a7586b67901d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:46.386503 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b826df68-5bac-4acc-8efe-a7586b67901d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:46.387355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b826df68-5bac-4acc-8efe-a7586b67901d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:46.387796 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b826df68-5bac-4acc-8efe-a7586b67901d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:46.451170 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b826df68-5bac-4acc-8efe-a7586b67901d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:46.458967 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b826df68-5bac-4acc-8efe-a7586b67901d tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 200 len: 1465 microversion: 2.1 time: 0.084723 Jun 16 19:01:46.459531 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 412/791] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:46 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 1465 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:47.476130 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3b6b100c-202d-49aa-8434-17c34e6673ae tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:47.476833 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3b6b100c-202d-49aa-8434-17c34e6673ae tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 410bdd70-d5fd-4cfe-ad04-cf135bef00ff] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:47.483540 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3b6b100c-202d-49aa-8434-17c34e6673ae tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:47.483991 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3b6b100c-202d-49aa-8434-17c34e6673ae tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:47.484752 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3b6b100c-202d-49aa-8434-17c34e6673ae tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:47.485192 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3b6b100c-202d-49aa-8434-17c34e6673ae tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:47.498412 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-3b6b100c-202d-49aa-8434-17c34e6673ae tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] HTTP exception thrown: Instance 410bdd70-d5fd-4cfe-ad04-cf135bef00ff could not be found. Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3b6b100c-202d-49aa-8434-17c34e6673ae tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Request method failure captured: Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff HTTP/1.1 Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq3zGXPpz6QpTlYMAzUwZA2FxpZlcsMj2PZk5Me98X004ESO6iHhtyZi01S2HrA7QRavaFYn_gvj72vUb3j1o8y1FEQDlH2mCzxj0otKQa2G_t9ABiX9PFlgtXlKad4vu-Z7kFV6K2VyP4Foc5kZ5IbGmbuR92aI1zzs_J7gOZWCDPP0 Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: ed8501d1ff734054ba0a6ef4c398d051 Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1664066176 Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:01:47.500031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:01:47.502054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ed8501d1ff734054ba0a6ef4c398d051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ed8501d1ff734054ba0a6ef4c398d051", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ed8501d1ff734054ba0a6ef4c398d051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ed8501d1ff734054ba0a6ef4c398d051"}]}] Jun 16 19:01:47.502054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1664066176 Jun 16 19:01:47.502054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: ed8501d1ff734054ba0a6ef4c398d051 Jun 16 19:01:47.502054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1664066176 Jun 16 19:01:47.502054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-ServerRescueNegativeTestJSON-1664066176-project Jun 16 19:01:47.502054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:01:47.502054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:01:47.502054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 7310c631282c495a83e17dbdbc6d2ba0 Jun 16 19:01:47.502054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1664066176-project Jun 16 19:01:47.502054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:01:47.502054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance 410bdd70-d5fd-4cfe-ad04-cf135bef00ff could not be found. Jun 16 19:01:47.502054 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': '410bdd70-d5fd-4cfe-ad04-cf135bef00ff'} Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410bdd70-d5fd-4cfe-ad04-cf135bef00ff could not be found. Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:01:47.502956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410bdd70-d5fd-4cfe-ad04-cf135bef00ff could not be found. Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410bdd70-d5fd-4cfe-ad04-cf135bef00ff could not be found. Jun 16 19:01:47.504390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:47.506049 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3b6b100c-202d-49aa-8434-17c34e6673ae tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Returning 404 to user: Instance 410bdd70-d5fd-4cfe-ad04-cf135bef00ff could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:01:47.506049 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3b6b100c-202d-49aa-8434-17c34e6673ae tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff" status: 404 len: 111 microversion: 2.1 time: 0.029531 Jun 16 19:01:47.506049 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 380/792] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:47 2022] GET /compute/v2.1/servers/410bdd70-d5fd-4cfe-ad04-cf135bef00ff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:01:47.510572 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6c46beb7-93b5-4e00-9264-71690b341ce4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:47.511073 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6c46beb7-93b5-4e00-9264-71690b341ce4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:47.518226 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c46beb7-93b5-4e00-9264-71690b341ce4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:47.518678 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c46beb7-93b5-4e00-9264-71690b341ce4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:47.519436 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c46beb7-93b5-4e00-9264-71690b341ce4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:47.519870 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c46beb7-93b5-4e00-9264-71690b341ce4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:47.543852 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6c46beb7-93b5-4e00-9264-71690b341ce4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Going to try to terminate instance {{(pid=130229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:01:47.772940 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6c46beb7-93b5-4e00-9264-71690b341ce4 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "DELETE /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 204 len: 0 microversion: 2.1 time: 0.265922 Jun 16 19:01:47.773471 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 413/793] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:01:47 2022] DELETE /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:01:47.781275 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d089ce9a-067c-456a-82d6-1e85d01e21cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:47.781884 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d089ce9a-067c-456a-82d6-1e85d01e21cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:47.787873 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d089ce9a-067c-456a-82d6-1e85d01e21cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:47.788320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d089ce9a-067c-456a-82d6-1e85d01e21cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:47.789074 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d089ce9a-067c-456a-82d6-1e85d01e21cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:47.789532 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d089ce9a-067c-456a-82d6-1e85d01e21cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:47.920695 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d089ce9a-067c-456a-82d6-1e85d01e21cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:47.928780 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d089ce9a-067c-456a-82d6-1e85d01e21cf tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.151305 Jun 16 19:01:47.929358 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 381/794] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:47 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:48.350736 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-69632953-9ff0-44ac-a748-0f9000333ad0 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:48.351314 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-69632953-9ff0-44ac-a748-0f9000333ad0 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:48.357368 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-69632953-9ff0-44ac-a748-0f9000333ad0 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:48.357836 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-69632953-9ff0-44ac-a748-0f9000333ad0 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:48.358584 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-69632953-9ff0-44ac-a748-0f9000333ad0 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:48.359017 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-69632953-9ff0-44ac-a748-0f9000333ad0 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:48.383901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-69632953-9ff0-44ac-a748-0f9000333ad0 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Going to try to terminate instance {{(pid=130229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:01:48.698756 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-69632953-9ff0-44ac-a748-0f9000333ad0 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 204 len: 0 microversion: 2.1 time: 0.351838 Jun 16 19:01:48.699383 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 414/795] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:01:48 2022] DELETE /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:01:48.707864 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9c978aab-b0e0-4539-af41-61b2bff832b3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:48.708469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9c978aab-b0e0-4539-af41-61b2bff832b3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:48.715053 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c978aab-b0e0-4539-af41-61b2bff832b3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:48.715495 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c978aab-b0e0-4539-af41-61b2bff832b3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:48.716247 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c978aab-b0e0-4539-af41-61b2bff832b3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:48.716674 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c978aab-b0e0-4539-af41-61b2bff832b3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:48.844677 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9c978aab-b0e0-4539-af41-61b2bff832b3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:48.852217 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9c978aab-b0e0-4539-af41-61b2bff832b3 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1579 microversion: 2.1 time: 0.148782 Jun 16 19:01:48.852805 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 382/796] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:48 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1579 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:48.946645 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a0e443bc-6659-425b-8cce-64348d129815 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:48.947366 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a0e443bc-6659-425b-8cce-64348d129815 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:48.953411 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a0e443bc-6659-425b-8cce-64348d129815 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:48.953812 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a0e443bc-6659-425b-8cce-64348d129815 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:48.954576 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a0e443bc-6659-425b-8cce-64348d129815 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:48.955567 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a0e443bc-6659-425b-8cce-64348d129815 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:48.962688 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:49.085047 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a0e443bc-6659-425b-8cce-64348d129815 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:49.092599 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a0e443bc-6659-425b-8cce-64348d129815 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.150234 Jun 16 19:01:49.093167 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 415/797] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:48 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:49.868870 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4b14736b-32c1-46fa-9d13-176e030551da tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:49.869530 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4b14736b-32c1-46fa-9d13-176e030551da tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:49.876319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4b14736b-32c1-46fa-9d13-176e030551da tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:49.876770 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4b14736b-32c1-46fa-9d13-176e030551da tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:49.878064 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4b14736b-32c1-46fa-9d13-176e030551da tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:49.878501 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4b14736b-32c1-46fa-9d13-176e030551da tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:50.011230 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4b14736b-32c1-46fa-9d13-176e030551da tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:50.018663 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4b14736b-32c1-46fa-9d13-176e030551da tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1579 microversion: 2.1 time: 0.153749 Jun 16 19:01:50.019226 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 383/798] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:49 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:50.109906 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4185fee3-0755-42d1-9c14-5cee23941aa3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:50.110522 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4185fee3-0755-42d1-9c14-5cee23941aa3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:50.117062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4185fee3-0755-42d1-9c14-5cee23941aa3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:50.117534 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4185fee3-0755-42d1-9c14-5cee23941aa3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:50.118329 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4185fee3-0755-42d1-9c14-5cee23941aa3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:50.118762 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4185fee3-0755-42d1-9c14-5cee23941aa3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:50.250080 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4185fee3-0755-42d1-9c14-5cee23941aa3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:50.258267 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4185fee3-0755-42d1-9c14-5cee23941aa3 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.152250 Jun 16 19:01:50.258842 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 416/799] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:50 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:51.036074 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a33f05f0-0070-4417-9b7a-47654f77c880 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:51.036678 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a33f05f0-0070-4417-9b7a-47654f77c880 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:51.043567 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a33f05f0-0070-4417-9b7a-47654f77c880 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:51.044012 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a33f05f0-0070-4417-9b7a-47654f77c880 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:51.044770 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a33f05f0-0070-4417-9b7a-47654f77c880 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:51.045203 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a33f05f0-0070-4417-9b7a-47654f77c880 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:51.174910 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a33f05f0-0070-4417-9b7a-47654f77c880 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:51.182375 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a33f05f0-0070-4417-9b7a-47654f77c880 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1579 microversion: 2.1 time: 0.150460 Jun 16 19:01:51.182943 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 384/800] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:51 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1579 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:51.275233 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-08b51a3c-cd23-4186-bf9a-3a86c1aded20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:51.275848 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-08b51a3c-cd23-4186-bf9a-3a86c1aded20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:51.282196 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08b51a3c-cd23-4186-bf9a-3a86c1aded20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:51.282640 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08b51a3c-cd23-4186-bf9a-3a86c1aded20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:51.283396 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08b51a3c-cd23-4186-bf9a-3a86c1aded20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:51.283865 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08b51a3c-cd23-4186-bf9a-3a86c1aded20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:51.410756 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-08b51a3c-cd23-4186-bf9a-3a86c1aded20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:51.418108 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-08b51a3c-cd23-4186-bf9a-3a86c1aded20 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1520 microversion: 2.1 time: 0.146691 Jun 16 19:01:51.418671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 417/801] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:51 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:52.198882 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2e51ff09-ad49-468e-9281-2fbc45198e57 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:52.199487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2e51ff09-ad49-468e-9281-2fbc45198e57 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:52.206362 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2e51ff09-ad49-468e-9281-2fbc45198e57 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:52.206810 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2e51ff09-ad49-468e-9281-2fbc45198e57 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:52.207566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2e51ff09-ad49-468e-9281-2fbc45198e57 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:52.207996 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2e51ff09-ad49-468e-9281-2fbc45198e57 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:52.435735 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f78f0951-095e-4b84-8574-b9f4f69fa099 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:52.438249 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f78f0951-095e-4b84-8574-b9f4f69fa099 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:52.443229 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f78f0951-095e-4b84-8574-b9f4f69fa099 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:52.443677 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f78f0951-095e-4b84-8574-b9f4f69fa099 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:52.444440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f78f0951-095e-4b84-8574-b9f4f69fa099 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:52.444869 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f78f0951-095e-4b84-8574-b9f4f69fa099 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:52.490861 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2e51ff09-ad49-468e-9281-2fbc45198e57 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:52.499232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2e51ff09-ad49-468e-9281-2fbc45198e57 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1579 microversion: 2.1 time: 0.304207 Jun 16 19:01:52.500085 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 385/802] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:52 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1579 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:52.558296 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f78f0951-095e-4b84-8574-b9f4f69fa099 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7310c631282c495a83e17dbdbc6d2ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8501d1ff734054ba0a6ef4c398d051', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:52.566289 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f78f0951-095e-4b84-8574-b9f4f69fa099 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 200 len: 1478 microversion: 2.1 time: 0.134465 Jun 16 19:01:52.570069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 418/803] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:52 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 1478 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:52.592162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-374d38e3-81aa-44ff-8f53-b83c5b65e726 req-5b10c365-ef6a-4b95-a36b-5d1a79da7997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25fe61a4-e1c1-4098-91db-fbb42c8b1d7b", "name": "network-vif-deleted", "tag": "3e4f94ae-ac05-441d-a1fa-fa6601b9d389"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:52.600113 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-374d38e3-81aa-44ff-8f53-b83c5b65e726 req-5b10c365-ef6a-4b95-a36b-5d1a79da7997 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:52.602425 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-374d38e3-81aa-44ff-8f53-b83c5b65e726 req-5b10c365-ef6a-4b95-a36b-5d1a79da7997 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:52.612208 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-374d38e3-81aa-44ff-8f53-b83c5b65e726 req-5b10c365-ef6a-4b95-a36b-5d1a79da7997 service nova] Creating event network-vif-deleted:3e4f94ae-ac05-441d-a1fa-fa6601b9d389 for instance 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b on hv-cinder-84617 Jun 16 19:01:52.617552 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-374d38e3-81aa-44ff-8f53-b83c5b65e726 req-5b10c365-ef6a-4b95-a36b-5d1a79da7997 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028926 Jun 16 19:01:52.618166 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 386/804] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:01:53.517710 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c15c3167-a6fc-461b-a0f5-868a73819755 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:53.518648 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c15c3167-a6fc-461b-a0f5-868a73819755 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:53.525452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c15c3167-a6fc-461b-a0f5-868a73819755 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:53.526001 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c15c3167-a6fc-461b-a0f5-868a73819755 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:53.526893 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c15c3167-a6fc-461b-a0f5-868a73819755 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:53.527586 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c15c3167-a6fc-461b-a0f5-868a73819755 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:53.585443 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-0f53adca-3387-4a63-a393-c1b04ce485e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:53.586185 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-0f53adca-3387-4a63-a393-c1b04ce485e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] [instance: 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:53.603430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c15c3167-a6fc-461b-a0f5-868a73819755 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:53.605156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0f53adca-3387-4a63-a393-c1b04ce485e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:53.607734 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0f53adca-3387-4a63-a393-c1b04ce485e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:53.608723 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0f53adca-3387-4a63-a393-c1b04ce485e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:53.609338 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0f53adca-3387-4a63-a393-c1b04ce485e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:53.613442 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c15c3167-a6fc-461b-a0f5-868a73819755 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 200 len: 1226 microversion: 2.1 time: 0.100445 Jun 16 19:01:53.624255 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 419/805] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:53 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:53.633475 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-0f53adca-3387-4a63-a393-c1b04ce485e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] HTTP exception thrown: Instance 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b could not be found. Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-0f53adca-3387-4a63-a393-c1b04ce485e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Request method failure captured: Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b HTTP/1.1 Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq3zGXPpz6QpTlYMAzUwZA2FxpZlcsMj2PZk5Me98X004ESO6iHhtyZi01S2HrA7QRavaFYn_gvj72vUb3j1o8y1FEQDlH2mCzxj0otKQa2G_t9ABiX9PFlgtXlKad4vu-Z7kFV6K2VyP4Foc5kZ5IbGmbuR92aI1zzs_J7gOZWCDPP0 Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: ed8501d1ff734054ba0a6ef4c398d051 Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1664066176 Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:01:53.635128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:01:53.636594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ed8501d1ff734054ba0a6ef4c398d051"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_ed8501d1ff734054ba0a6ef4c398d051", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/ed8501d1ff734054ba0a6ef4c398d051"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/ed8501d1ff734054ba0a6ef4c398d051"}]}] Jun 16 19:01:53.636594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1664066176 Jun 16 19:01:53.636594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: ed8501d1ff734054ba0a6ef4c398d051 Jun 16 19:01:53.636594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1664066176 Jun 16 19:01:53.636594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-ServerRescueNegativeTestJSON-1664066176-project Jun 16 19:01:53.636594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:01:53.636594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:01:53.636594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 7310c631282c495a83e17dbdbc6d2ba0 Jun 16 19:01:53.636594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1664066176-project Jun 16 19:01:53.636594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:01:53.636594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b could not be found. Jun 16 19:01:53.636594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': '25fe61a4-e1c1-4098-91db-fbb42c8b1d7b'} Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b could not be found. Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:01:53.637541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b could not be found. Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b could not be found. Jun 16 19:01:53.638956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:01:53.641029 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-0f53adca-3387-4a63-a393-c1b04ce485e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] Returning 404 to user: Instance 25fe61a4-e1c1-4098-91db-fbb42c8b1d7b could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:01:53.641029 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-0f53adca-3387-4a63-a393-c1b04ce485e9 tempest-ServerRescueNegativeTestJSON-1664066176 tempest-ServerRescueNegativeTestJSON-1664066176-project] 10.222.0.81 "GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b" status: 404 len: 111 microversion: 2.1 time: 0.055317 Jun 16 19:01:53.641029 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 387/806] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:53 2022] GET /compute/v2.1/servers/25fe61a4-e1c1-4098-91db-fbb42c8b1d7b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:01:54.630804 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e83bffdc-586c-47ce-b892-2db4a3bab81d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:54.631436 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e83bffdc-586c-47ce-b892-2db4a3bab81d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:54.638110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e83bffdc-586c-47ce-b892-2db4a3bab81d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:54.638555 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e83bffdc-586c-47ce-b892-2db4a3bab81d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:54.639318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e83bffdc-586c-47ce-b892-2db4a3bab81d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:54.639747 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e83bffdc-586c-47ce-b892-2db4a3bab81d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:54.653109 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-e83bffdc-586c-47ce-b892-2db4a3bab81d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] HTTP exception thrown: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e83bffdc-586c-47ce-b892-2db4a3bab81d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Request method failure captured: Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b HTTP/1.1 Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq30361t7E8doIA6nwYkO3vD4KCZTaRR9Q0WWFAXPQeVo3ZUvcXZScN8v32Zwpv-WHAlG6FZv-LYGnOD1MjwQttBV8Ubwx0B0WINdW_g8UesKwVW5nRA3cDgte6vHx0prOEICzTT0JXhVRtWoQWQ6wb8PoQyXRrN5cbDOSfrhmmNUgLc Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: fc32e3179c534d83b3d4108a38fb9d19 Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-TestVolumeBootPattern-1915969095 Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:01:54.654803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:01:54.656589 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fc32e3179c534d83b3d4108a38fb9d19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_fc32e3179c534d83b3d4108a38fb9d19", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fc32e3179c534d83b3d4108a38fb9d19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/fc32e3179c534d83b3d4108a38fb9d19"}]}] Jun 16 19:01:54.656589 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-TestVolumeBootPattern-1915969095 Jun 16 19:01:54.656589 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: fc32e3179c534d83b3d4108a38fb9d19 Jun 16 19:01:54.656589 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-TestVolumeBootPattern-1915969095 Jun 16 19:01:54.656589 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-TestVolumeBootPattern-1915969095-project Jun 16 19:01:54.656589 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:01:54.656589 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:01:54.656589 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 1c0e7e9f9d0f409a8820d8bd8dd239cf Jun 16 19:01:54.656589 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-TestVolumeBootPattern-1915969095-project Jun 16 19:01:54.656589 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:01:54.656589 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. Jun 16 19:01:54.656589 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': 'd73e2d8a-72b0-45bc-9693-eecf5c504b5b'} Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:01:54.657593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. Jun 16 19:01:54.659048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:01:54.660436 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e83bffdc-586c-47ce-b892-2db4a3bab81d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Returning 404 to user: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:01:54.660436 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e83bffdc-586c-47ce-b892-2db4a3bab81d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 404 len: 111 microversion: 2.1 time: 0.029978 Jun 16 19:01:54.660436 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 420/807] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:54 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:01:54.679474 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-407c395f-f784-4cb1-afbb-f77a6b21b11f req-2ead1d69-f38d-4ee7-a4dc-615646e5389f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73e2d8a-72b0-45bc-9693-eecf5c504b5b", "name": "network-vif-deleted", "tag": "0709fc5a-ab77-4d05-928e-4bfc5179ed37"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:54.698201 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-407c395f-f784-4cb1-afbb-f77a6b21b11f req-2ead1d69-f38d-4ee7-a4dc-615646e5389f service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:54.700672 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-407c395f-f784-4cb1-afbb-f77a6b21b11f req-2ead1d69-f38d-4ee7-a4dc-615646e5389f service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:54.715450 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-407c395f-f784-4cb1-afbb-f77a6b21b11f req-2ead1d69-f38d-4ee7-a4dc-615646e5389f service nova] Creating event network-vif-deleted:0709fc5a-ab77-4d05-928e-4bfc5179ed37 for instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b on hv-cinder-84617 Jun 16 19:01:54.720676 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-407c395f-f784-4cb1-afbb-f77a6b21b11f req-2ead1d69-f38d-4ee7-a4dc-615646e5389f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053575 Jun 16 19:01:54.721992 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 388/808] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:54.763669 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-799271182", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1310473773", "security_groups": [{"name": "tempest-secgroup-smoke-1909774442"}], "block_device_mapping_v2": [{"uuid": "3b066cf3-25d7-4f57-a47c-c6067b2a8f8f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f31f33e6-f431-4d4c-a847-a5f33b248bb8"}]}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:54.933131 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.network.neutron [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] validate_networks() for [('f31f33e6-f431-4d4c-a847-a5f33b248bb8', None, None, None, None, None)] {{(pid=130229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:01:55.772799 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Flavor limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:01:55.773507 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Image limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:01:55.773829 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Flavor pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:01:55.774348 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Image pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:01:55.776662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:01:55.788651 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:55.789210 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:55.790449 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:55.790986 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:55.811483 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Getting quotas for project fc32e3179c534d83b3d4108a38fb9d19. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:01:55.816685 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Getting quotas for user 1c0e7e9f9d0f409a8820d8bd8dd239cf and project fc32e3179c534d83b3d4108a38fb9d19. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:01:55.879470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Going to run 1 instances... {{(pid=130229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:01:55.881695 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3b066cf3-25d7-4f57-a47c-c6067b2a8f8f',volume_size=None,volume_type=None)] {{(pid=130229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:01:56.353260 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-bc3ded2f-5f21-499c-94f4-bce533347bb2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.593414 Jun 16 19:01:56.353927 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 421/809] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 19:01:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:01:56.367808 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-938cf284-2975-4c86-821b-79acbc5fb745 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:56.369029 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-938cf284-2975-4c86-821b-79acbc5fb745 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:56.429164 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-938cf284-2975-4c86-821b-79acbc5fb745 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:56.437299 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-938cf284-2975-4c86-821b-79acbc5fb745 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1094 microversion: 2.1 time: 0.076246 Jun 16 19:01:56.441290 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 389/810] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:56 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:57.454462 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-49fd2664-72cb-48ad-b827-f1d591529be2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:57.455164 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-49fd2664-72cb-48ad-b827-f1d591529be2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:57.462201 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-49fd2664-72cb-48ad-b827-f1d591529be2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:57.463002 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-49fd2664-72cb-48ad-b827-f1d591529be2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:57.463872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-49fd2664-72cb-48ad-b827-f1d591529be2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:57.464315 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-49fd2664-72cb-48ad-b827-f1d591529be2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:57.531898 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-49fd2664-72cb-48ad-b827-f1d591529be2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:57.540026 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-49fd2664-72cb-48ad-b827-f1d591529be2 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1144 microversion: 2.1 time: 0.089565 Jun 16 19:01:57.541159 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 422/811] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:57 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:58.557046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5ee98d3a-6e2b-4750-964a-3bc441af2937 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:58.558081 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5ee98d3a-6e2b-4750-964a-3bc441af2937 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:58.570992 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5ee98d3a-6e2b-4750-964a-3bc441af2937 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:58.570992 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5ee98d3a-6e2b-4750-964a-3bc441af2937 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:58.571904 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5ee98d3a-6e2b-4750-964a-3bc441af2937 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:58.572388 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5ee98d3a-6e2b-4750-964a-3bc441af2937 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:58.645718 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5ee98d3a-6e2b-4750-964a-3bc441af2937 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:58.653392 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5ee98d3a-6e2b-4750-964a-3bc441af2937 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1210 microversion: 2.1 time: 0.100188 Jun 16 19:01:58.654017 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 390/812] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:58 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:59.672197 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a4db4792-75f4-4317-8e36-430deafae28a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:59.673636 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a4db4792-75f4-4317-8e36-430deafae28a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:59.682426 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a4db4792-75f4-4317-8e36-430deafae28a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:59.682876 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a4db4792-75f4-4317-8e36-430deafae28a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:59.684092 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a4db4792-75f4-4317-8e36-430deafae28a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:59.684540 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a4db4792-75f4-4317-8e36-430deafae28a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:59.973775 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a4db4792-75f4-4317-8e36-430deafae28a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:59.982748 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a4db4792-75f4-4317-8e36-430deafae28a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1278 microversion: 2.1 time: 0.315582 Jun 16 19:01:59.983323 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 423/813] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:59 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1278 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:00.478868 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-4ba5711d-407f-4eff-852e-ba3883462c25 req-04ea4cd1-025c-456a-bd96-9939fc8baa77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0e627a-a28a-419d-854b-63e81d67a3f7", "tag": "66d9152b-c02c-4f61-9fe8-f277bc4c64a1"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:00.502201 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-4ba5711d-407f-4eff-852e-ba3883462c25 req-04ea4cd1-025c-456a-bd96-9939fc8baa77 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:00.502647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-4ba5711d-407f-4eff-852e-ba3883462c25 req-04ea4cd1-025c-456a-bd96-9939fc8baa77 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:00.518658 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-4ba5711d-407f-4eff-852e-ba3883462c25 req-04ea4cd1-025c-456a-bd96-9939fc8baa77 service nova] Creating event network-changed:66d9152b-c02c-4f61-9fe8-f277bc4c64a1 for instance 5b0e627a-a28a-419d-854b-63e81d67a3f7 on hv-cinder-84617 Jun 16 19:02:00.524359 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-4ba5711d-407f-4eff-852e-ba3883462c25 req-04ea4cd1-025c-456a-bd96-9939fc8baa77 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049858 Jun 16 19:02:00.524968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 391/814] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:00.999835 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-de3cccc1-7ad8-46d3-aea6-98aace1cb646 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:01.007684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-de3cccc1-7ad8-46d3-aea6-98aace1cb646 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:01.007684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:01.009822 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-de3cccc1-7ad8-46d3-aea6-98aace1cb646 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:01.010274 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-de3cccc1-7ad8-46d3-aea6-98aace1cb646 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:01.011135 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-de3cccc1-7ad8-46d3-aea6-98aace1cb646 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:01.011572 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-de3cccc1-7ad8-46d3-aea6-98aace1cb646 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:01.147162 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-de3cccc1-7ad8-46d3-aea6-98aace1cb646 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:01.155739 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-de3cccc1-7ad8-46d3-aea6-98aace1cb646 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1266 microversion: 2.1 time: 0.159391 Jun 16 19:02:01.156400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 424/815] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:00 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:02.174632 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-86c522ac-964f-4a7a-b440-3f36e9b77993 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:02.175756 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-86c522ac-964f-4a7a-b440-3f36e9b77993 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:02.182358 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-86c522ac-964f-4a7a-b440-3f36e9b77993 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:02.182812 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-86c522ac-964f-4a7a-b440-3f36e9b77993 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:02.183587 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-86c522ac-964f-4a7a-b440-3f36e9b77993 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:02.184026 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-86c522ac-964f-4a7a-b440-3f36e9b77993 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:02.317861 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-86c522ac-964f-4a7a-b440-3f36e9b77993 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:02.325296 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-86c522ac-964f-4a7a-b440-3f36e9b77993 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1266 microversion: 2.1 time: 0.154929 Jun 16 19:02:02.325865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 392/816] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:02 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:03.342287 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-20929ad1-3ea6-44b6-af77-59df569d1336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:03.342899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-20929ad1-3ea6-44b6-af77-59df569d1336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:03.349615 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-20929ad1-3ea6-44b6-af77-59df569d1336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:03.350057 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-20929ad1-3ea6-44b6-af77-59df569d1336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:03.350812 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-20929ad1-3ea6-44b6-af77-59df569d1336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:03.351244 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-20929ad1-3ea6-44b6-af77-59df569d1336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:03.479944 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-20929ad1-3ea6-44b6-af77-59df569d1336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:03.487814 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-20929ad1-3ea6-44b6-af77-59df569d1336 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1266 microversion: 2.1 time: 0.149662 Jun 16 19:02:03.488399 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 425/817] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:03 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:04.505919 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1a7bfb8b-efd5-405e-aff7-6178da51f6be tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:04.506525 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1a7bfb8b-efd5-405e-aff7-6178da51f6be tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:04.512954 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1a7bfb8b-efd5-405e-aff7-6178da51f6be tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:04.513422 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1a7bfb8b-efd5-405e-aff7-6178da51f6be tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:04.514182 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1a7bfb8b-efd5-405e-aff7-6178da51f6be tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:04.514609 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1a7bfb8b-efd5-405e-aff7-6178da51f6be tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:04.518511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=100 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:04.649028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1a7bfb8b-efd5-405e-aff7-6178da51f6be tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:04.656438 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1a7bfb8b-efd5-405e-aff7-6178da51f6be tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1266 microversion: 2.1 time: 0.154990 Jun 16 19:02:04.656995 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 393/818] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:04 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:05.673043 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ef80bcbc-ae80-49fa-8485-a00ddcdc7139 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:05.673758 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ef80bcbc-ae80-49fa-8485-a00ddcdc7139 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:05.680283 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ef80bcbc-ae80-49fa-8485-a00ddcdc7139 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:05.680732 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ef80bcbc-ae80-49fa-8485-a00ddcdc7139 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:05.681533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ef80bcbc-ae80-49fa-8485-a00ddcdc7139 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:05.681967 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ef80bcbc-ae80-49fa-8485-a00ddcdc7139 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:05.799094 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:05.807954 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ef80bcbc-ae80-49fa-8485-a00ddcdc7139 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:05.815344 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ef80bcbc-ae80-49fa-8485-a00ddcdc7139 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1266 microversion: 2.1 time: 0.146258 Jun 16 19:02:05.816386 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 426/819] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:05 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:06.832353 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-88ca9b8a-09b4-42c9-aa44-a679928b6870 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:06.833542 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-88ca9b8a-09b4-42c9-aa44-a679928b6870 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:06.838968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:06.840893 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-88ca9b8a-09b4-42c9-aa44-a679928b6870 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:06.841357 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-88ca9b8a-09b4-42c9-aa44-a679928b6870 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:06.842122 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-88ca9b8a-09b4-42c9-aa44-a679928b6870 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:06.842552 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-88ca9b8a-09b4-42c9-aa44-a679928b6870 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:06.983155 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-88ca9b8a-09b4-42c9-aa44-a679928b6870 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:06.991097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-88ca9b8a-09b4-42c9-aa44-a679928b6870 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1266 microversion: 2.1 time: 0.162741 Jun 16 19:02:06.991673 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 394/820] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:06 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:08.008981 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-08edca27-963b-411a-bb24-7afed29aac6f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:08.009540 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-08edca27-963b-411a-bb24-7afed29aac6f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:08.011362 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=6 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:08.016852 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08edca27-963b-411a-bb24-7afed29aac6f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:08.017327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08edca27-963b-411a-bb24-7afed29aac6f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:08.018151 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08edca27-963b-411a-bb24-7afed29aac6f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:08.018581 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08edca27-963b-411a-bb24-7afed29aac6f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:08.148785 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-08edca27-963b-411a-bb24-7afed29aac6f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:08.156248 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-08edca27-963b-411a-bb24-7afed29aac6f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1266 microversion: 2.1 time: 0.152189 Jun 16 19:02:08.156804 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 427/821] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:08 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:09.172833 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f1a16b0a-8076-4fd4-8ac6-5be5dc5a3e76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:09.173474 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f1a16b0a-8076-4fd4-8ac6-5be5dc5a3e76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:09.179862 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f1a16b0a-8076-4fd4-8ac6-5be5dc5a3e76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:09.180304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f1a16b0a-8076-4fd4-8ac6-5be5dc5a3e76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:09.181053 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f1a16b0a-8076-4fd4-8ac6-5be5dc5a3e76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:09.181556 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f1a16b0a-8076-4fd4-8ac6-5be5dc5a3e76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:09.312093 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f1a16b0a-8076-4fd4-8ac6-5be5dc5a3e76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:09.320034 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f1a16b0a-8076-4fd4-8ac6-5be5dc5a3e76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1266 microversion: 2.1 time: 0.151033 Jun 16 19:02:09.320603 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 395/822] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:09 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:10.343933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-50dc271f-9cf5-40f8-a907-770aee6f6c2c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:10.344581 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-50dc271f-9cf5-40f8-a907-770aee6f6c2c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:10.351961 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-50dc271f-9cf5-40f8-a907-770aee6f6c2c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:10.352429 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-50dc271f-9cf5-40f8-a907-770aee6f6c2c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:10.353189 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-50dc271f-9cf5-40f8-a907-770aee6f6c2c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:10.353687 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-50dc271f-9cf5-40f8-a907-770aee6f6c2c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:10.489400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-50dc271f-9cf5-40f8-a907-770aee6f6c2c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:10.495986 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-50dc271f-9cf5-40f8-a907-770aee6f6c2c tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1266 microversion: 2.1 time: 0.155930 Jun 16 19:02:10.496550 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 428/823] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:10 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:11.512884 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4aa7bdf8-5675-4a10-98fa-73ca3511eb70 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:11.513526 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4aa7bdf8-5675-4a10-98fa-73ca3511eb70 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:11.520647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4aa7bdf8-5675-4a10-98fa-73ca3511eb70 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:11.520770 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4aa7bdf8-5675-4a10-98fa-73ca3511eb70 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:11.521485 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4aa7bdf8-5675-4a10-98fa-73ca3511eb70 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:11.521913 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4aa7bdf8-5675-4a10-98fa-73ca3511eb70 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:11.660161 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4aa7bdf8-5675-4a10-98fa-73ca3511eb70 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:11.669048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4aa7bdf8-5675-4a10-98fa-73ca3511eb70 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1266 microversion: 2.1 time: 0.159927 Jun 16 19:02:11.669722 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 396/824] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:11 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:12.343152 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-55b4bafe-e88d-47ff-abf7-8e5e66b79c12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:12.343688 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-55b4bafe-e88d-47ff-abf7-8e5e66b79c12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:12.350444 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-55b4bafe-e88d-47ff-abf7-8e5e66b79c12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:12.350891 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-55b4bafe-e88d-47ff-abf7-8e5e66b79c12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:12.351697 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-55b4bafe-e88d-47ff-abf7-8e5e66b79c12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:12.352273 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-55b4bafe-e88d-47ff-abf7-8e5e66b79c12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:12.376790 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-55b4bafe-e88d-47ff-abf7-8e5e66b79c12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339/ips" status: 200 len: 151 microversion: 2.20 time: 0.039194 Jun 16 19:02:12.377447 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 429/825] 10.222.0.81 () {60 vars in 1288 bytes} [Thu Jun 16 19:02:12 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:02:12.669904 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-0f467216-d276-4397-8221-e04fc7d675af req-8c68504c-6bfc-4e4f-92db-10233df1e412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0e627a-a28a-419d-854b-63e81d67a3f7", "name": "network-vif-plugged", "status": "completed", "tag": "66d9152b-c02c-4f61-9fe8-f277bc4c64a1"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:12.673947 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:12.687893 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a59703b7-1549-436c-a0f4-fdae08759725 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:12.689625 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a59703b7-1549-436c-a0f4-fdae08759725 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:12.700226 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a59703b7-1549-436c-a0f4-fdae08759725 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:12.707200 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-0f467216-d276-4397-8221-e04fc7d675af req-8c68504c-6bfc-4e4f-92db-10233df1e412 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:12.707200 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-0f467216-d276-4397-8221-e04fc7d675af req-8c68504c-6bfc-4e4f-92db-10233df1e412 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:12.707650 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a59703b7-1549-436c-a0f4-fdae08759725 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:12.707650 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a59703b7-1549-436c-a0f4-fdae08759725 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:12.707650 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a59703b7-1549-436c-a0f4-fdae08759725 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:12.723189 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-0f467216-d276-4397-8221-e04fc7d675af req-8c68504c-6bfc-4e4f-92db-10233df1e412 service nova] Creating event network-vif-plugged:66d9152b-c02c-4f61-9fe8-f277bc4c64a1 for instance 5b0e627a-a28a-419d-854b-63e81d67a3f7 on hv-cinder-84617 Jun 16 19:02:12.732796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-0f467216-d276-4397-8221-e04fc7d675af req-8c68504c-6bfc-4e4f-92db-10233df1e412 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188594 Jun 16 19:02:12.733447 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 397/826] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:12.867292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a59703b7-1549-436c-a0f4-fdae08759725 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:12.876702 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a59703b7-1549-436c-a0f4-fdae08759725 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1266 microversion: 2.1 time: 0.193613 Jun 16 19:02:12.877493 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 430/827] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:12 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:13.894047 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9ad6b6d2-b993-4319-8e9a-d14a9e437342 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:13.894783 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9ad6b6d2-b993-4319-8e9a-d14a9e437342 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:13.902479 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9ad6b6d2-b993-4319-8e9a-d14a9e437342 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:13.902939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9ad6b6d2-b993-4319-8e9a-d14a9e437342 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:13.903707 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9ad6b6d2-b993-4319-8e9a-d14a9e437342 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:13.904144 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9ad6b6d2-b993-4319-8e9a-d14a9e437342 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:14.036891 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9ad6b6d2-b993-4319-8e9a-d14a9e437342 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:14.044371 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9ad6b6d2-b993-4319-8e9a-d14a9e437342 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1266 microversion: 2.1 time: 0.154481 Jun 16 19:02:14.044928 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 398/828] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:13 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:14.656351 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-92293fa2-d9ab-4e49-b377-9803bace9a10 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:14.656873 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-92293fa2-d9ab-4e49-b377-9803bace9a10 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:14.663430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-92293fa2-d9ab-4e49-b377-9803bace9a10 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:14.663882 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-92293fa2-d9ab-4e49-b377-9803bace9a10 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:14.664647 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-92293fa2-d9ab-4e49-b377-9803bace9a10 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:14.665116 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-92293fa2-d9ab-4e49-b377-9803bace9a10 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:14.687355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-92293fa2-d9ab-4e49-b377-9803bace9a10 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lazy-loading 'flavor' on Instance uuid 33ad0030-d602-4eda-932c-e5a9ff1a7339 {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:02:14.865327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:15.061128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-863d030e-ee2c-4c85-b004-06bb398eab0d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:15.061778 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-863d030e-ee2c-4c85-b004-06bb398eab0d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:15.068464 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-863d030e-ee2c-4c85-b004-06bb398eab0d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:15.068994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-863d030e-ee2c-4c85-b004-06bb398eab0d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:15.069789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-863d030e-ee2c-4c85-b004-06bb398eab0d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:15.070227 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-863d030e-ee2c-4c85-b004-06bb398eab0d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:15.203782 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-863d030e-ee2c-4c85-b004-06bb398eab0d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:15.211265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-863d030e-ee2c-4c85-b004-06bb398eab0d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1266 microversion: 2.1 time: 0.154207 Jun 16 19:02:15.211894 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 399/829] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:15 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:15.250205 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-92293fa2-d9ab-4e49-b377-9803bace9a10 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "POST /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339/action" status: 202 len: 0 microversion: 2.20 time: 0.597610 Jun 16 19:02:15.250756 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 431/830] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jun 16 19:02:14 2022] POST /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:02:15.258933 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6809ccf0-433e-4a32-97a8-b0401861a706 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:15.259546 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6809ccf0-433e-4a32-97a8-b0401861a706 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:15.265573 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6809ccf0-433e-4a32-97a8-b0401861a706 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:15.266013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6809ccf0-433e-4a32-97a8-b0401861a706 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:15.266775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6809ccf0-433e-4a32-97a8-b0401861a706 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:15.267209 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6809ccf0-433e-4a32-97a8-b0401861a706 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:15.398924 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6809ccf0-433e-4a32-97a8-b0401861a706 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:15.406840 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6809ccf0-433e-4a32-97a8-b0401861a706 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:15.408358 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6809ccf0-433e-4a32-97a8-b0401861a706 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:15.409551 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6809ccf0-433e-4a32-97a8-b0401861a706 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.154603 Jun 16 19:02:15.410115 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 400/831] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:15 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:16.229811 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-258caf6f-eb3d-446c-a1d4-15668e682613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:16.230502 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-258caf6f-eb3d-446c-a1d4-15668e682613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:16.236804 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-258caf6f-eb3d-446c-a1d4-15668e682613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:16.237278 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-258caf6f-eb3d-446c-a1d4-15668e682613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:16.238045 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-258caf6f-eb3d-446c-a1d4-15668e682613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:16.238483 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-258caf6f-eb3d-446c-a1d4-15668e682613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:16.371659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-258caf6f-eb3d-446c-a1d4-15668e682613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:16.379306 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-258caf6f-eb3d-446c-a1d4-15668e682613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1266 microversion: 2.1 time: 0.154408 Jun 16 19:02:16.380131 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 432/832] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:16 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:16.428452 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e31ffac8-e9cf-48d6-adf0-d56241cc90c2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:16.429056 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e31ffac8-e9cf-48d6-adf0-d56241cc90c2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:16.435617 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e31ffac8-e9cf-48d6-adf0-d56241cc90c2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:16.436058 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e31ffac8-e9cf-48d6-adf0-d56241cc90c2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:16.436807 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e31ffac8-e9cf-48d6-adf0-d56241cc90c2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:16.437233 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e31ffac8-e9cf-48d6-adf0-d56241cc90c2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:16.564414 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e31ffac8-e9cf-48d6-adf0-d56241cc90c2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:16.572980 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e31ffac8-e9cf-48d6-adf0-d56241cc90c2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:16.574522 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e31ffac8-e9cf-48d6-adf0-d56241cc90c2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:16.575761 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e31ffac8-e9cf-48d6-adf0-d56241cc90c2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.151143 Jun 16 19:02:16.576322 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 401/833] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:16 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:17.396286 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-71e6190b-7d18-4fb9-8f17-1348e8e8f613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:17.396899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-71e6190b-7d18-4fb9-8f17-1348e8e8f613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:17.403359 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-71e6190b-7d18-4fb9-8f17-1348e8e8f613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:17.403806 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-71e6190b-7d18-4fb9-8f17-1348e8e8f613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:17.404563 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-71e6190b-7d18-4fb9-8f17-1348e8e8f613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:17.405000 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-71e6190b-7d18-4fb9-8f17-1348e8e8f613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:17.535869 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-71e6190b-7d18-4fb9-8f17-1348e8e8f613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:17.543856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-71e6190b-7d18-4fb9-8f17-1348e8e8f613 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1266 microversion: 2.1 time: 0.151457 Jun 16 19:02:17.544412 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 433/834] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:17 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:17.594780 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-8b3b1dcf-7199-442a-a84a-38d427dd6f7d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:17.595552 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-8b3b1dcf-7199-442a-a84a-38d427dd6f7d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:17.602793 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8b3b1dcf-7199-442a-a84a-38d427dd6f7d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:17.603242 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8b3b1dcf-7199-442a-a84a-38d427dd6f7d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:17.604007 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8b3b1dcf-7199-442a-a84a-38d427dd6f7d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:17.604443 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8b3b1dcf-7199-442a-a84a-38d427dd6f7d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:17.892990 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8b3b1dcf-7199-442a-a84a-38d427dd6f7d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:17.901771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8b3b1dcf-7199-442a-a84a-38d427dd6f7d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:17.903261 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8b3b1dcf-7199-442a-a84a-38d427dd6f7d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:17.904460 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-8b3b1dcf-7199-442a-a84a-38d427dd6f7d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.313617 Jun 16 19:02:17.905008 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 402/835] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:17 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:18.560862 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c778f2f4-8f61-43ae-9f12-05792459cb5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:18.561506 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c778f2f4-8f61-43ae-9f12-05792459cb5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:18.568723 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c778f2f4-8f61-43ae-9f12-05792459cb5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:18.569169 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c778f2f4-8f61-43ae-9f12-05792459cb5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:18.569974 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c778f2f4-8f61-43ae-9f12-05792459cb5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:18.570409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c778f2f4-8f61-43ae-9f12-05792459cb5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:18.698707 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c778f2f4-8f61-43ae-9f12-05792459cb5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:18.706423 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c778f2f4-8f61-43ae-9f12-05792459cb5a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1453 microversion: 2.1 time: 0.149204 Jun 16 19:02:18.706762 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 434/836] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:18 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:18.721717 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3e3d9c89-abdf-4b78-830e-7607b4c87afa tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:18.722335 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3e3d9c89-abdf-4b78-830e-7607b4c87afa tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:18.729341 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3e3d9c89-abdf-4b78-830e-7607b4c87afa tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:18.729797 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3e3d9c89-abdf-4b78-830e-7607b4c87afa tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:18.730613 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3e3d9c89-abdf-4b78-830e-7607b4c87afa tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:18.730994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3e3d9c89-abdf-4b78-830e-7607b4c87afa tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:18.863903 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-3e3d9c89-abdf-4b78-830e-7607b4c87afa tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:18.872619 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3e3d9c89-abdf-4b78-830e-7607b4c87afa tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1453 microversion: 2.1 time: 0.154376 Jun 16 19:02:18.873190 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 403/837] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:18 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:18.923294 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d543e049-6658-4dc4-8d34-b197418fe2f5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:18.923912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d543e049-6658-4dc4-8d34-b197418fe2f5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:18.934058 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d543e049-6658-4dc4-8d34-b197418fe2f5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:18.934516 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d543e049-6658-4dc4-8d34-b197418fe2f5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:18.935894 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d543e049-6658-4dc4-8d34-b197418fe2f5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:18.935894 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d543e049-6658-4dc4-8d34-b197418fe2f5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:19.132639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d543e049-6658-4dc4-8d34-b197418fe2f5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:19.140781 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d543e049-6658-4dc4-8d34-b197418fe2f5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:19.142265 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d543e049-6658-4dc4-8d34-b197418fe2f5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:19.143421 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d543e049-6658-4dc4-8d34-b197418fe2f5 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.224324 Jun 16 19:02:19.143985 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 435/838] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:18 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:20.162180 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-dc7fe61f-739f-4005-b258-c3538be3eb9e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:20.162784 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-dc7fe61f-739f-4005-b258-c3538be3eb9e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:20.169678 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-dc7fe61f-739f-4005-b258-c3538be3eb9e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:20.170133 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-dc7fe61f-739f-4005-b258-c3538be3eb9e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:20.170942 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-dc7fe61f-739f-4005-b258-c3538be3eb9e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:20.171374 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-dc7fe61f-739f-4005-b258-c3538be3eb9e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:20.406041 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-dc7fe61f-739f-4005-b258-c3538be3eb9e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:20.414656 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-dc7fe61f-739f-4005-b258-c3538be3eb9e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:20.416148 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-dc7fe61f-739f-4005-b258-c3538be3eb9e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:20.417363 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-dc7fe61f-739f-4005-b258-c3538be3eb9e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.259115 Jun 16 19:02:20.418150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 404/839] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:20 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:21.274942 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-f60c76f4-5372-4c48-9723-b9ed87ec13f3 req-f48dc868-35e5-42cd-82fd-2875d4635e3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0e627a-a28a-419d-854b-63e81d67a3f7", "tag": "66d9152b-c02c-4f61-9fe8-f277bc4c64a1"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:21.283706 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-f60c76f4-5372-4c48-9723-b9ed87ec13f3 req-f48dc868-35e5-42cd-82fd-2875d4635e3b service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:21.284172 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-f60c76f4-5372-4c48-9723-b9ed87ec13f3 req-f48dc868-35e5-42cd-82fd-2875d4635e3b service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:21.296129 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-f60c76f4-5372-4c48-9723-b9ed87ec13f3 req-f48dc868-35e5-42cd-82fd-2875d4635e3b service nova] Creating event network-changed:66d9152b-c02c-4f61-9fe8-f277bc4c64a1 for instance 5b0e627a-a28a-419d-854b-63e81d67a3f7 on hv-cinder-84617 Jun 16 19:02:21.301805 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-f60c76f4-5372-4c48-9723-b9ed87ec13f3 req-f48dc868-35e5-42cd-82fd-2875d4635e3b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030456 Jun 16 19:02:21.303239 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 436/840] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:21.444137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-aa6873ad-afc1-479e-b831-04162aa3c5a9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:21.444749 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-aa6873ad-afc1-479e-b831-04162aa3c5a9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:21.451091 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aa6873ad-afc1-479e-b831-04162aa3c5a9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:21.451541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aa6873ad-afc1-479e-b831-04162aa3c5a9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:21.452353 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aa6873ad-afc1-479e-b831-04162aa3c5a9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:21.452846 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aa6873ad-afc1-479e-b831-04162aa3c5a9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:21.585349 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-aa6873ad-afc1-479e-b831-04162aa3c5a9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:21.593223 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-aa6873ad-afc1-479e-b831-04162aa3c5a9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:21.594759 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-aa6873ad-afc1-479e-b831-04162aa3c5a9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:21.595925 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-aa6873ad-afc1-479e-b831-04162aa3c5a9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.155773 Jun 16 19:02:21.596484 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 405/841] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:21 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:22.615026 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-59c7bb17-7df1-45f7-81a0-7400ee596094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:22.620397 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-59c7bb17-7df1-45f7-81a0-7400ee596094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:22.622415 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-59c7bb17-7df1-45f7-81a0-7400ee596094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:22.623176 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-59c7bb17-7df1-45f7-81a0-7400ee596094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:22.623950 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-59c7bb17-7df1-45f7-81a0-7400ee596094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:22.624375 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-59c7bb17-7df1-45f7-81a0-7400ee596094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:22.823717 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-59c7bb17-7df1-45f7-81a0-7400ee596094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:22.832075 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-59c7bb17-7df1-45f7-81a0-7400ee596094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:22.834178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-59c7bb17-7df1-45f7-81a0-7400ee596094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:22.835396 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-59c7bb17-7df1-45f7-81a0-7400ee596094 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.225056 Jun 16 19:02:22.835943 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 437/842] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:22 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:23.853399 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d87d3878-74e8-4d37-bba8-275d4472e227 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:23.853945 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d87d3878-74e8-4d37-bba8-275d4472e227 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:23.860255 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d87d3878-74e8-4d37-bba8-275d4472e227 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:23.860699 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d87d3878-74e8-4d37-bba8-275d4472e227 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:23.861502 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d87d3878-74e8-4d37-bba8-275d4472e227 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:23.861922 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d87d3878-74e8-4d37-bba8-275d4472e227 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:23.995161 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d87d3878-74e8-4d37-bba8-275d4472e227 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:24.003300 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d87d3878-74e8-4d37-bba8-275d4472e227 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:24.004806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d87d3878-74e8-4d37-bba8-275d4472e227 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:24.006023 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d87d3878-74e8-4d37-bba8-275d4472e227 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.156616 Jun 16 19:02:24.006567 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 406/843] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:23 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:25.024677 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a370bfae-d751-4f6b-a9ff-82e65250f860 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:25.025793 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a370bfae-d751-4f6b-a9ff-82e65250f860 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:25.033698 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a370bfae-d751-4f6b-a9ff-82e65250f860 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.034147 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a370bfae-d751-4f6b-a9ff-82e65250f860 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.034907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a370bfae-d751-4f6b-a9ff-82e65250f860 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.035360 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a370bfae-d751-4f6b-a9ff-82e65250f860 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.168672 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a370bfae-d751-4f6b-a9ff-82e65250f860 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:25.176704 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a370bfae-d751-4f6b-a9ff-82e65250f860 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:25.178241 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a370bfae-d751-4f6b-a9ff-82e65250f860 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:25.179402 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a370bfae-d751-4f6b-a9ff-82e65250f860 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.159389 Jun 16 19:02:25.179954 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 438/844] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:25 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:26.197215 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-70d660e8-0f6a-40b7-b433-b7f9ecd3412b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:26.197786 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-70d660e8-0f6a-40b7-b433-b7f9ecd3412b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:26.204147 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-70d660e8-0f6a-40b7-b433-b7f9ecd3412b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:26.204586 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-70d660e8-0f6a-40b7-b433-b7f9ecd3412b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:26.205372 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-70d660e8-0f6a-40b7-b433-b7f9ecd3412b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:26.205802 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-70d660e8-0f6a-40b7-b433-b7f9ecd3412b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:26.336111 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-70d660e8-0f6a-40b7-b433-b7f9ecd3412b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:26.343928 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-70d660e8-0f6a-40b7-b433-b7f9ecd3412b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:26.345482 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-70d660e8-0f6a-40b7-b433-b7f9ecd3412b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:26.346661 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-70d660e8-0f6a-40b7-b433-b7f9ecd3412b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.153365 Jun 16 19:02:26.347220 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 407/845] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:26 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:26.556053 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-fcff23e1-c926-45a0-9c8a-6a5641a63fe3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:26.556610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-fcff23e1-c926-45a0-9c8a-6a5641a63fe3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:26.563074 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fcff23e1-c926-45a0-9c8a-6a5641a63fe3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:26.563521 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fcff23e1-c926-45a0-9c8a-6a5641a63fe3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:26.564287 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fcff23e1-c926-45a0-9c8a-6a5641a63fe3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:26.564755 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fcff23e1-c926-45a0-9c8a-6a5641a63fe3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:26.588175 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-fcff23e1-c926-45a0-9c8a-6a5641a63fe3 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/ips" status: 200 len: 145 microversion: 2.1 time: 0.036128 Jun 16 19:02:26.588728 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 439/846] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jun 16 19:02:26 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:27.364037 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4d258a86-3e29-414a-b666-c7c67b02b570 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:27.364648 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4d258a86-3e29-414a-b666-c7c67b02b570 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:27.372070 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4d258a86-3e29-414a-b666-c7c67b02b570 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:27.372518 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4d258a86-3e29-414a-b666-c7c67b02b570 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:27.373694 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4d258a86-3e29-414a-b666-c7c67b02b570 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:27.374117 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4d258a86-3e29-414a-b666-c7c67b02b570 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:27.504318 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4d258a86-3e29-414a-b666-c7c67b02b570 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:27.512296 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4d258a86-3e29-414a-b666-c7c67b02b570 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:27.513846 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4d258a86-3e29-414a-b666-c7c67b02b570 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:27.515011 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4d258a86-3e29-414a-b666-c7c67b02b570 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.155025 Jun 16 19:02:27.515568 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 408/847] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:27 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:28.533831 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5aafe974-2276-4b55-b850-becbc392001e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:28.534416 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5aafe974-2276-4b55-b850-becbc392001e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:28.541033 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5aafe974-2276-4b55-b850-becbc392001e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:28.541518 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5aafe974-2276-4b55-b850-becbc392001e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:28.542292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5aafe974-2276-4b55-b850-becbc392001e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:28.542735 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5aafe974-2276-4b55-b850-becbc392001e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:28.672172 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5aafe974-2276-4b55-b850-becbc392001e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:28.680079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5aafe974-2276-4b55-b850-becbc392001e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:28.681594 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5aafe974-2276-4b55-b850-becbc392001e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:28.682775 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5aafe974-2276-4b55-b850-becbc392001e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.152997 Jun 16 19:02:28.683319 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 440/848] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:28 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:29.298087 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e23a77a3-2d68-488e-a3ce-c287007a8360 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65c8a00e-9f99-41ae-89a5-e8bb1b9780cc"}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:29.309027 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e23a77a3-2d68-488e-a3ce-c287007a8360 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:29.309027 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e23a77a3-2d68-488e-a3ce-c287007a8360 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:29.309027 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e23a77a3-2d68-488e-a3ce-c287007a8360 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:29.309027 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e23a77a3-2d68-488e-a3ce-c287007a8360 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:29.309422 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e23a77a3-2d68-488e-a3ce-c287007a8360 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:29.503591 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:29.701602 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e7662a2c-6d64-4cc0-956f-8b83c9fb05c9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:29.702255 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e7662a2c-6d64-4cc0-956f-8b83c9fb05c9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:29.708300 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e7662a2c-6d64-4cc0-956f-8b83c9fb05c9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:29.708737 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e7662a2c-6d64-4cc0-956f-8b83c9fb05c9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:29.709517 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e7662a2c-6d64-4cc0-956f-8b83c9fb05c9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:29.709950 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e7662a2c-6d64-4cc0-956f-8b83c9fb05c9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:29.840244 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e7662a2c-6d64-4cc0-956f-8b83c9fb05c9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:29.848421 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e7662a2c-6d64-4cc0-956f-8b83c9fb05c9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:29.849953 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e7662a2c-6d64-4cc0-956f-8b83c9fb05c9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:29.851111 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e7662a2c-6d64-4cc0-956f-8b83c9fb05c9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.153471 Jun 16 19:02:29.851675 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 441/849] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:29 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:02:30.105739 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e23a77a3-2d68-488e-a3ce-c287007a8360 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "POST /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.811344 Jun 16 19:02:30.106341 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 409/850] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jun 16 19:02:29 2022] POST /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments => generated 194 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:30.869492 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8131fed7-fabf-4cf6-ad14-edfe924132f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:30.870145 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8131fed7-fabf-4cf6-ad14-edfe924132f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:30.877164 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8131fed7-fabf-4cf6-ad14-edfe924132f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:30.877653 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8131fed7-fabf-4cf6-ad14-edfe924132f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:30.878664 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8131fed7-fabf-4cf6-ad14-edfe924132f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:30.878926 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8131fed7-fabf-4cf6-ad14-edfe924132f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:31.016260 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8131fed7-fabf-4cf6-ad14-edfe924132f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:31.029692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8131fed7-fabf-4cf6-ad14-edfe924132f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:31.035195 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8131fed7-fabf-4cf6-ad14-edfe924132f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:31.040825 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8131fed7-fabf-4cf6-ad14-edfe924132f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.171008 Jun 16 19:02:31.040825 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 442/851] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:30 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:32.056942 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5320500f-6e8a-4776-b7b3-6102a2055df3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:32.057656 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5320500f-6e8a-4776-b7b3-6102a2055df3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:32.063905 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5320500f-6e8a-4776-b7b3-6102a2055df3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:32.064345 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5320500f-6e8a-4776-b7b3-6102a2055df3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:32.065129 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5320500f-6e8a-4776-b7b3-6102a2055df3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:32.065583 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5320500f-6e8a-4776-b7b3-6102a2055df3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:32.195476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5320500f-6e8a-4776-b7b3-6102a2055df3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:32.203261 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5320500f-6e8a-4776-b7b3-6102a2055df3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:32.204806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5320500f-6e8a-4776-b7b3-6102a2055df3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:32.205984 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5320500f-6e8a-4776-b7b3-6102a2055df3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.153865 Jun 16 19:02:32.206562 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 410/852] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:32 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:33.225745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d690b37e-48a3-4cab-a391-3112861fdc83 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:33.226366 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d690b37e-48a3-4cab-a391-3112861fdc83 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:33.232897 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d690b37e-48a3-4cab-a391-3112861fdc83 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:33.233449 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d690b37e-48a3-4cab-a391-3112861fdc83 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:33.234159 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d690b37e-48a3-4cab-a391-3112861fdc83 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:33.234601 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d690b37e-48a3-4cab-a391-3112861fdc83 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:33.362137 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d690b37e-48a3-4cab-a391-3112861fdc83 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:33.370794 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d690b37e-48a3-4cab-a391-3112861fdc83 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:33.372312 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d690b37e-48a3-4cab-a391-3112861fdc83 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:33.373508 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d690b37e-48a3-4cab-a391-3112861fdc83 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.152209 Jun 16 19:02:33.374326 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 443/853] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:33 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:34.391171 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-7c38d4b6-ccca-4632-a4e5-68d27ecb599b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:34.391780 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-7c38d4b6-ccca-4632-a4e5-68d27ecb599b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:34.398228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7c38d4b6-ccca-4632-a4e5-68d27ecb599b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:34.398686 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7c38d4b6-ccca-4632-a4e5-68d27ecb599b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:34.399452 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7c38d4b6-ccca-4632-a4e5-68d27ecb599b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:34.399895 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7c38d4b6-ccca-4632-a4e5-68d27ecb599b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:34.544893 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-7c38d4b6-ccca-4632-a4e5-68d27ecb599b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:34.553796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-7c38d4b6-ccca-4632-a4e5-68d27ecb599b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:34.555312 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-7c38d4b6-ccca-4632-a4e5-68d27ecb599b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:34.556457 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-7c38d4b6-ccca-4632-a4e5-68d27ecb599b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1742 microversion: 2.20 time: 0.169195 Jun 16 19:02:34.557010 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 411/854] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:34 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1742 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:35.575439 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c39a2549-58b9-4a91-a111-3d17c1ee97b1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:35.576175 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c39a2549-58b9-4a91-a111-3d17c1ee97b1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:35.578777 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=40 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:35.583555 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c39a2549-58b9-4a91-a111-3d17c1ee97b1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:35.584544 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c39a2549-58b9-4a91-a111-3d17c1ee97b1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:35.585364 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c39a2549-58b9-4a91-a111-3d17c1ee97b1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:35.585805 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c39a2549-58b9-4a91-a111-3d17c1ee97b1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:35.718148 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c39a2549-58b9-4a91-a111-3d17c1ee97b1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:35.726804 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c39a2549-58b9-4a91-a111-3d17c1ee97b1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:35.734441 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c39a2549-58b9-4a91-a111-3d17c1ee97b1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:35.735644 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c39a2549-58b9-4a91-a111-3d17c1ee97b1 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1742 microversion: 2.20 time: 0.164277 Jun 16 19:02:35.737620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 444/855] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:35 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:36.755307 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-572f2afa-b237-49de-9918-b651751e0612 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:36.755683 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-572f2afa-b237-49de-9918-b651751e0612 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:36.762971 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-572f2afa-b237-49de-9918-b651751e0612 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:36.763530 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-572f2afa-b237-49de-9918-b651751e0612 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:36.764763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-572f2afa-b237-49de-9918-b651751e0612 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:36.765340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-572f2afa-b237-49de-9918-b651751e0612 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:36.919547 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-572f2afa-b237-49de-9918-b651751e0612 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:36.929141 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-572f2afa-b237-49de-9918-b651751e0612 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:36.930915 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-572f2afa-b237-49de-9918-b651751e0612 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:36.937874 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-572f2afa-b237-49de-9918-b651751e0612 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1737 microversion: 2.20 time: 0.186985 Jun 16 19:02:36.949879 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 412/856] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:36 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:37.623016 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-219b1663-372e-40e3-8d81-2256411ab652 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:37.625149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-219b1663-372e-40e3-8d81-2256411ab652 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:37.633547 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-219b1663-372e-40e3-8d81-2256411ab652 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:37.634453 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-219b1663-372e-40e3-8d81-2256411ab652 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:37.636612 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-219b1663-372e-40e3-8d81-2256411ab652 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:37.637274 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-219b1663-372e-40e3-8d81-2256411ab652 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:37.673445 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-219b1663-372e-40e3-8d81-2256411ab652 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055796 Jun 16 19:02:37.674223 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 445/857] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:02:37 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:37.684116 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-892823aa-9b85-4180-8145-2197e314b377 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:37.684623 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-892823aa-9b85-4180-8145-2197e314b377 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:37.697939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-892823aa-9b85-4180-8145-2197e314b377 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:37.698857 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-892823aa-9b85-4180-8145-2197e314b377 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:37.699807 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-892823aa-9b85-4180-8145-2197e314b377 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:37.700422 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-892823aa-9b85-4180-8145-2197e314b377 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:37.736411 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-892823aa-9b85-4180-8145-2197e314b377 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments/65c8a00e-9f99-41ae-89a5-e8bb1b9780cc" status: 200 len: 194 microversion: 2.1 time: 0.055962 Jun 16 19:02:37.737347 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 413/858] 10.222.0.81 () {58 vars in 1412 bytes} [Thu Jun 16 19:02:37 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments/65c8a00e-9f99-41ae-89a5-e8bb1b9780cc => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:37.956864 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-59cea590-9bc2-4683-8473-b60c5c2a66f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:37.957514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-59cea590-9bc2-4683-8473-b60c5c2a66f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:37.963887 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-59cea590-9bc2-4683-8473-b60c5c2a66f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:37.964548 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-59cea590-9bc2-4683-8473-b60c5c2a66f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:37.965517 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-59cea590-9bc2-4683-8473-b60c5c2a66f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:37.966308 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-59cea590-9bc2-4683-8473-b60c5c2a66f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:38.149008 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-59cea590-9bc2-4683-8473-b60c5c2a66f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:38.162404 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-59cea590-9bc2-4683-8473-b60c5c2a66f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:38.164061 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-59cea590-9bc2-4683-8473-b60c5c2a66f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:38.165435 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-59cea590-9bc2-4683-8473-b60c5c2a66f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1737 microversion: 2.20 time: 0.212274 Jun 16 19:02:38.167468 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 446/859] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:37 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:38.685132 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-590f2456-6b8f-451b-ae5a-f17698189f09 req-d9dd5d44-eb82-4dbe-8e40-691d4d507904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33ad0030-d602-4eda-932c-e5a9ff1a7339", "name": "network-vif-plugged", "status": "completed", "tag": "876dcbc0-6957-426a-86fc-525cbbd501e9"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:38.710493 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-590f2456-6b8f-451b-ae5a-f17698189f09 req-d9dd5d44-eb82-4dbe-8e40-691d4d507904 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:38.711237 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-590f2456-6b8f-451b-ae5a-f17698189f09 req-d9dd5d44-eb82-4dbe-8e40-691d4d507904 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:38.730989 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-590f2456-6b8f-451b-ae5a-f17698189f09 req-d9dd5d44-eb82-4dbe-8e40-691d4d507904 service nova] Creating event network-vif-plugged:876dcbc0-6957-426a-86fc-525cbbd501e9 for instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 on hv-cinder-84617 Jun 16 19:02:38.740173 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-590f2456-6b8f-451b-ae5a-f17698189f09 req-d9dd5d44-eb82-4dbe-8e40-691d4d507904 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059313 Jun 16 19:02:38.741949 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 414/860] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:39.184506 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a2eaafeb-13ce-48fd-94a7-bdebdbd10eaf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:39.185413 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a2eaafeb-13ce-48fd-94a7-bdebdbd10eaf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:39.193281 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a2eaafeb-13ce-48fd-94a7-bdebdbd10eaf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:39.193951 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a2eaafeb-13ce-48fd-94a7-bdebdbd10eaf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:39.194907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a2eaafeb-13ce-48fd-94a7-bdebdbd10eaf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:39.195535 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a2eaafeb-13ce-48fd-94a7-bdebdbd10eaf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:39.394403 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a2eaafeb-13ce-48fd-94a7-bdebdbd10eaf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:39.404263 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a2eaafeb-13ce-48fd-94a7-bdebdbd10eaf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:39.417414 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a2eaafeb-13ce-48fd-94a7-bdebdbd10eaf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:39.417414 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a2eaafeb-13ce-48fd-94a7-bdebdbd10eaf tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1737 microversion: 2.20 time: 0.228110 Jun 16 19:02:39.417414 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 447/861] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:39 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:39.423619 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-40cdff5c-dcca-4533-9a00-cf853e89af70 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcfb6722-3dd7-4428-bb50-d56869baae6a"}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:39.425061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-40cdff5c-dcca-4533-9a00-cf853e89af70 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:39.432255 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-40cdff5c-dcca-4533-9a00-cf853e89af70 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:39.432703 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-40cdff5c-dcca-4533-9a00-cf853e89af70 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:39.433712 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-40cdff5c-dcca-4533-9a00-cf853e89af70 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:39.434158 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-40cdff5c-dcca-4533-9a00-cf853e89af70 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:40.426552 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1fd15404-9390-4a31-a334-805fcdaf527a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:40.427259 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-1fd15404-9390-4a31-a334-805fcdaf527a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:40.442712 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1fd15404-9390-4a31-a334-805fcdaf527a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:40.445232 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1fd15404-9390-4a31-a334-805fcdaf527a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:40.446337 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1fd15404-9390-4a31-a334-805fcdaf527a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:40.447107 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1fd15404-9390-4a31-a334-805fcdaf527a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:40.575561 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-40cdff5c-dcca-4533-9a00-cf853e89af70 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "POST /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.156608 Jun 16 19:02:40.581081 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 415/862] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jun 16 19:02:39 2022] POST /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments => generated 194 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:40.703631 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1fd15404-9390-4a31-a334-805fcdaf527a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:40.712464 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1fd15404-9390-4a31-a334-805fcdaf527a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:40.714859 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1fd15404-9390-4a31-a334-805fcdaf527a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:40.716214 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-1fd15404-9390-4a31-a334-805fcdaf527a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1737 microversion: 2.20 time: 0.293771 Jun 16 19:02:40.728123 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 448/863] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:40 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1737 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:41.737522 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-56e021dc-14dc-453a-a17d-07c4391e4dae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:41.738787 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-56e021dc-14dc-453a-a17d-07c4391e4dae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:41.746533 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-56e021dc-14dc-453a-a17d-07c4391e4dae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:41.750737 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-56e021dc-14dc-453a-a17d-07c4391e4dae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:41.752117 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-56e021dc-14dc-453a-a17d-07c4391e4dae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:41.752873 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-56e021dc-14dc-453a-a17d-07c4391e4dae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:41.914765 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-56e021dc-14dc-453a-a17d-07c4391e4dae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:41.923538 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-56e021dc-14dc-453a-a17d-07c4391e4dae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:41.925034 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-56e021dc-14dc-453a-a17d-07c4391e4dae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:41.926449 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-56e021dc-14dc-453a-a17d-07c4391e4dae tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1737 microversion: 2.20 time: 0.195075 Jun 16 19:02:41.927004 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 416/864] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:41 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:42.946666 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-207022f2-b7c8-4717-837e-9301d4639b0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:42.947319 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-207022f2-b7c8-4717-837e-9301d4639b0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:42.954156 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-207022f2-b7c8-4717-837e-9301d4639b0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:42.954635 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-207022f2-b7c8-4717-837e-9301d4639b0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:42.955486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-207022f2-b7c8-4717-837e-9301d4639b0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:42.955975 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-207022f2-b7c8-4717-837e-9301d4639b0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:42.958653 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:43.097809 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-207022f2-b7c8-4717-837e-9301d4639b0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:43.106765 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-207022f2-b7c8-4717-837e-9301d4639b0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:43.153339 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-207022f2-b7c8-4717-837e-9301d4639b0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:43.153339 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-207022f2-b7c8-4717-837e-9301d4639b0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1737 microversion: 2.20 time: 0.167497 Jun 16 19:02:43.153339 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 449/865] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:42 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:44.171569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-aa036225-c99d-4172-becd-ece89fcbc46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:44.172186 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-aa036225-c99d-4172-becd-ece89fcbc46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:44.174841 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=40 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:44.180499 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aa036225-c99d-4172-becd-ece89fcbc46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:44.181513 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aa036225-c99d-4172-becd-ece89fcbc46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:44.182556 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aa036225-c99d-4172-becd-ece89fcbc46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:44.183007 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-aa036225-c99d-4172-becd-ece89fcbc46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:44.330540 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-aa036225-c99d-4172-becd-ece89fcbc46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:44.342673 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-aa036225-c99d-4172-becd-ece89fcbc46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:44.344714 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-aa036225-c99d-4172-becd-ece89fcbc46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:44.345977 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-aa036225-c99d-4172-becd-ece89fcbc46c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1737 microversion: 2.20 time: 0.178550 Jun 16 19:02:44.348950 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 417/866] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:44 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:45.366162 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-30aca67e-4231-44dd-abb1-44f30ade55f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:45.367432 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-30aca67e-4231-44dd-abb1-44f30ade55f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:45.376011 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-30aca67e-4231-44dd-abb1-44f30ade55f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:45.376465 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-30aca67e-4231-44dd-abb1-44f30ade55f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:45.377297 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-30aca67e-4231-44dd-abb1-44f30ade55f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:45.377902 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-30aca67e-4231-44dd-abb1-44f30ade55f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:45.541849 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-30aca67e-4231-44dd-abb1-44f30ade55f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:45.550722 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-30aca67e-4231-44dd-abb1-44f30ade55f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:45.552450 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-30aca67e-4231-44dd-abb1-44f30ade55f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:45.554486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-30aca67e-4231-44dd-abb1-44f30ade55f4 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1737 microversion: 2.20 time: 0.192985 Jun 16 19:02:45.555220 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 450/867] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:45 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:46.573204 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a2688775-bb75-4948-8ab4-56a2622f9900 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:46.574082 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a2688775-bb75-4948-8ab4-56a2622f9900 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:46.581594 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a2688775-bb75-4948-8ab4-56a2622f9900 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:46.582327 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a2688775-bb75-4948-8ab4-56a2622f9900 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:46.583123 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a2688775-bb75-4948-8ab4-56a2622f9900 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:46.583573 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a2688775-bb75-4948-8ab4-56a2622f9900 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:46.717770 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a2688775-bb75-4948-8ab4-56a2622f9900 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:46.727319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a2688775-bb75-4948-8ab4-56a2622f9900 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:46.728869 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a2688775-bb75-4948-8ab4-56a2622f9900 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:46.730169 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a2688775-bb75-4948-8ab4-56a2622f9900 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1737 microversion: 2.20 time: 0.161511 Jun 16 19:02:46.730740 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 418/868] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:46 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:47.748904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7551a397-3fac-4efa-8578-1f6d44bc2d65 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:47.749592 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7551a397-3fac-4efa-8578-1f6d44bc2d65 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:47.756351 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7551a397-3fac-4efa-8578-1f6d44bc2d65 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:47.756792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7551a397-3fac-4efa-8578-1f6d44bc2d65 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:47.757648 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7551a397-3fac-4efa-8578-1f6d44bc2d65 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:47.758723 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7551a397-3fac-4efa-8578-1f6d44bc2d65 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:47.890928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7551a397-3fac-4efa-8578-1f6d44bc2d65 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:47.898710 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7551a397-3fac-4efa-8578-1f6d44bc2d65 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:47.900198 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7551a397-3fac-4efa-8578-1f6d44bc2d65 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:47.901367 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7551a397-3fac-4efa-8578-1f6d44bc2d65 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1737 microversion: 2.20 time: 0.156435 Jun 16 19:02:47.901914 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 451/869] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:47 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:48.208876 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d00c5d97-5813-46f0-86cc-d543b0fd3848 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:48.209892 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d00c5d97-5813-46f0-86cc-d543b0fd3848 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:48.216294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d00c5d97-5813-46f0-86cc-d543b0fd3848 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:48.216739 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d00c5d97-5813-46f0-86cc-d543b0fd3848 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:48.217541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d00c5d97-5813-46f0-86cc-d543b0fd3848 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:48.217996 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d00c5d97-5813-46f0-86cc-d543b0fd3848 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:48.247904 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d00c5d97-5813-46f0-86cc-d543b0fd3848 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042838 Jun 16 19:02:48.248549 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 419/870] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:02:48 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:48.394507 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c0a5e110-93bf-4537-bc78-15bd59d2e289 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:48.395233 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c0a5e110-93bf-4537-bc78-15bd59d2e289 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:48.403859 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c0a5e110-93bf-4537-bc78-15bd59d2e289 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:48.404320 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c0a5e110-93bf-4537-bc78-15bd59d2e289 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:48.405094 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c0a5e110-93bf-4537-bc78-15bd59d2e289 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:48.405562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c0a5e110-93bf-4537-bc78-15bd59d2e289 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:48.442130 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c0a5e110-93bf-4537-bc78-15bd59d2e289 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments/65c8a00e-9f99-41ae-89a5-e8bb1b9780cc" status: 200 len: 194 microversion: 2.1 time: 0.051721 Jun 16 19:02:48.442721 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 452/871] 10.222.0.81 () {58 vars in 1412 bytes} [Thu Jun 16 19:02:48 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments/65c8a00e-9f99-41ae-89a5-e8bb1b9780cc => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:48.452868 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-526d1847-e37d-4ac2-abd2-49f1ffb38df4 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:48.453428 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-526d1847-e37d-4ac2-abd2-49f1ffb38df4 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:48.459676 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-526d1847-e37d-4ac2-abd2-49f1ffb38df4 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:48.460161 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-526d1847-e37d-4ac2-abd2-49f1ffb38df4 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:48.460930 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-526d1847-e37d-4ac2-abd2-49f1ffb38df4 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:48.461896 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-526d1847-e37d-4ac2-abd2-49f1ffb38df4 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:48.547789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.objects.instance [None req-526d1847-e37d-4ac2-abd2-49f1ffb38df4 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lazy-loading 'services' on Instance uuid effe0963-698f-48d6-adf3-6b53bf88e09c {{(pid=130230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:02:48.765419 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-526d1847-e37d-4ac2-abd2-49f1ffb38df4 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "DELETE /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments/65c8a00e-9f99-41ae-89a5-e8bb1b9780cc" status: 202 len: 0 microversion: 2.1 time: 0.316697 Jun 16 19:02:48.766009 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 420/872] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jun 16 19:02:48 2022] DELETE /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments/65c8a00e-9f99-41ae-89a5-e8bb1b9780cc => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:02:48.919474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-357b4365-6206-45da-b677-5783f0b6ee53 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:48.920153 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-357b4365-6206-45da-b677-5783f0b6ee53 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:48.926654 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-357b4365-6206-45da-b677-5783f0b6ee53 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:48.931151 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-357b4365-6206-45da-b677-5783f0b6ee53 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:48.931151 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-357b4365-6206-45da-b677-5783f0b6ee53 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:48.931151 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-357b4365-6206-45da-b677-5783f0b6ee53 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:49.068521 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-357b4365-6206-45da-b677-5783f0b6ee53 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:49.077493 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-357b4365-6206-45da-b677-5783f0b6ee53 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:49.079072 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-357b4365-6206-45da-b677-5783f0b6ee53 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:49.080229 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-357b4365-6206-45da-b677-5783f0b6ee53 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1719 microversion: 2.20 time: 0.164669 Jun 16 19:02:49.080794 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 453/873] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:48 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:49.508835 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:02:49.509373 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Thu Jun 16 19:02:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:02:50.100323 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4af5096f-9ac7-4bfd-a316-32762d04886e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:50.101030 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4af5096f-9ac7-4bfd-a316-32762d04886e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:50.107881 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4af5096f-9ac7-4bfd-a316-32762d04886e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:50.108333 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4af5096f-9ac7-4bfd-a316-32762d04886e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:50.109114 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4af5096f-9ac7-4bfd-a316-32762d04886e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:50.109591 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4af5096f-9ac7-4bfd-a316-32762d04886e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:50.241997 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4af5096f-9ac7-4bfd-a316-32762d04886e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:50.250376 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4af5096f-9ac7-4bfd-a316-32762d04886e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:50.251880 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4af5096f-9ac7-4bfd-a316-32762d04886e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:50.253047 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4af5096f-9ac7-4bfd-a316-32762d04886e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1719 microversion: 2.20 time: 0.158001 Jun 16 19:02:50.253622 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 421/874] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:50 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:51.273003 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6273f09a-804a-4beb-9f91-14a57711fdff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:51.274075 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6273f09a-804a-4beb-9f91-14a57711fdff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:51.281415 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6273f09a-804a-4beb-9f91-14a57711fdff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:51.281975 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6273f09a-804a-4beb-9f91-14a57711fdff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:51.283098 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6273f09a-804a-4beb-9f91-14a57711fdff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:51.283680 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6273f09a-804a-4beb-9f91-14a57711fdff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:51.416931 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6273f09a-804a-4beb-9f91-14a57711fdff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:51.424856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6273f09a-804a-4beb-9f91-14a57711fdff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:51.426385 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6273f09a-804a-4beb-9f91-14a57711fdff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:51.427543 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6273f09a-804a-4beb-9f91-14a57711fdff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1722 microversion: 2.20 time: 0.159325 Jun 16 19:02:51.428164 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 454/875] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:51 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:02:51.445035 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1afe365a-5913-4ea5-8fd5-4b9c48ea2d67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d9121e8-b001-4e9a-9e5a-00a1952f3ee3"}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:51.446175 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1afe365a-5913-4ea5-8fd5-4b9c48ea2d67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:51.452660 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1afe365a-5913-4ea5-8fd5-4b9c48ea2d67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:51.453114 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1afe365a-5913-4ea5-8fd5-4b9c48ea2d67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:51.453913 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1afe365a-5913-4ea5-8fd5-4b9c48ea2d67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:51.454349 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1afe365a-5913-4ea5-8fd5-4b9c48ea2d67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:51.967560 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=5 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:51.988788 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8a5003ce-d635-45c5-8515-13b53de00548 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:51.989309 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8a5003ce-d635-45c5-8515-13b53de00548 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:51.995387 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8a5003ce-d635-45c5-8515-13b53de00548 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:52.001751 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8a5003ce-d635-45c5-8515-13b53de00548 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:52.001751 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8a5003ce-d635-45c5-8515-13b53de00548 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:52.001751 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8a5003ce-d635-45c5-8515-13b53de00548 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:52.027516 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8a5003ce-d635-45c5-8515-13b53de00548 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments/dcfb6722-3dd7-4428-bb50-d56869baae6a" status: 200 len: 194 microversion: 2.1 time: 0.042792 Jun 16 19:02:52.029742 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 455/876] 10.222.0.81 () {58 vars in 1412 bytes} [Thu Jun 16 19:02:51 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments/dcfb6722-3dd7-4428-bb50-d56869baae6a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:02:52.037370 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a752dd9b-4d76-48c8-a272-99fcca72fb07 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:52.037904 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a752dd9b-4d76-48c8-a272-99fcca72fb07 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:52.043531 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a752dd9b-4d76-48c8-a272-99fcca72fb07 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:52.043983 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a752dd9b-4d76-48c8-a272-99fcca72fb07 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:52.044745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a752dd9b-4d76-48c8-a272-99fcca72fb07 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:52.045183 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a752dd9b-4d76-48c8-a272-99fcca72fb07 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:52.298994 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-a752dd9b-4d76-48c8-a272-99fcca72fb07 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lazy-loading 'services' on Instance uuid effe0963-698f-48d6-adf3-6b53bf88e09c {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:02:52.325603 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1afe365a-5913-4ea5-8fd5-4b9c48ea2d67 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "POST /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.884260 Jun 16 19:02:52.326218 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 422/877] 10.222.0.81 () {62 vars in 1363 bytes} [Thu Jun 16 19:02:51 2022] POST /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339/os-volume_attachments => generated 188 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 19:02:52.451666 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-fd5d8ce0-1aa5-47df-adfc-3bcdbc754961 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:52.452280 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-fd5d8ce0-1aa5-47df-adfc-3bcdbc754961 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:52.458837 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fd5d8ce0-1aa5-47df-adfc-3bcdbc754961 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:52.459345 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fd5d8ce0-1aa5-47df-adfc-3bcdbc754961 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:52.460115 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fd5d8ce0-1aa5-47df-adfc-3bcdbc754961 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:52.460551 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fd5d8ce0-1aa5-47df-adfc-3bcdbc754961 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:52.491257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a752dd9b-4d76-48c8-a272-99fcca72fb07 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "DELETE /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments/dcfb6722-3dd7-4428-bb50-d56869baae6a" status: 202 len: 0 microversion: 2.1 time: 0.457387 Jun 16 19:02:52.492469 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 456/878] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jun 16 19:02:52 2022] DELETE /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments/dcfb6722-3dd7-4428-bb50-d56869baae6a => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:02:52.643636 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-3c9a1af9-611e-452f-b249-2d735fc1e951 req-3b963525-2cab-4b87-aead-8ed9e9396891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33ad0030-d602-4eda-932c-e5a9ff1a7339", "name": "network-vif-unplugged", "status": "completed", "tag": "876dcbc0-6957-426a-86fc-525cbbd501e9"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:52.652424 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-3c9a1af9-611e-452f-b249-2d735fc1e951 req-3b963525-2cab-4b87-aead-8ed9e9396891 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:52.653103 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-3c9a1af9-611e-452f-b249-2d735fc1e951 req-3b963525-2cab-4b87-aead-8ed9e9396891 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:52.664327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.compute.server_external_events [req-3c9a1af9-611e-452f-b249-2d735fc1e951 req-3b963525-2cab-4b87-aead-8ed9e9396891 service nova] Unable to find a host for instance 33ad0030-d602-4eda-932c-e5a9ff1a7339. Dropping event network-vif-unplugged {{(pid=130229) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 19:02:52.665192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-3c9a1af9-611e-452f-b249-2d735fc1e951 req-3b963525-2cab-4b87-aead-8ed9e9396891 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026330 Jun 16 19:02:52.666515 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 457/879] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 16 19:02:53.028122 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-fd5d8ce0-1aa5-47df-adfc-3bcdbc754961 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "DELETE /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339/os-volume_attachments/4d9121e8-b001-4e9a-9e5a-00a1952f3ee3" status: 202 len: 0 microversion: 2.20 time: 0.580408 Jun 16 19:02:53.028645 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 423/880] 10.222.0.81 () {60 vars in 1456 bytes} [Thu Jun 16 19:02:52 2022] DELETE /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339/os-volume_attachments/4d9121e8-b001-4e9a-9e5a-00a1952f3ee3 => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 19:02:53.098312 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-633c9174-97be-4e8d-83e7-5633e29fdf6e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:53.099056 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-633c9174-97be-4e8d-83e7-5633e29fdf6e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:53.106785 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-633c9174-97be-4e8d-83e7-5633e29fdf6e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.107445 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-633c9174-97be-4e8d-83e7-5633e29fdf6e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.108456 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-633c9174-97be-4e8d-83e7-5633e29fdf6e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.109007 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-633c9174-97be-4e8d-83e7-5633e29fdf6e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.304730 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-633c9174-97be-4e8d-83e7-5633e29fdf6e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "POST /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339/action" status: 202 len: 0 microversion: 2.20 time: 0.210682 Jun 16 19:02:53.305406 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 458/881] 10.222.0.81 () {62 vars in 1318 bytes} [Thu Jun 16 19:02:53 2022] POST /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:02:53.313427 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5642ef0d-1bf1-4d60-b9ba-c33aee299110 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:53.314076 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5642ef0d-1bf1-4d60-b9ba-c33aee299110 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:53.320198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5642ef0d-1bf1-4d60-b9ba-c33aee299110 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.320658 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5642ef0d-1bf1-4d60-b9ba-c33aee299110 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.321464 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5642ef0d-1bf1-4d60-b9ba-c33aee299110 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.322413 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5642ef0d-1bf1-4d60-b9ba-c33aee299110 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.472350 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5642ef0d-1bf1-4d60-b9ba-c33aee299110 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:53.480928 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5642ef0d-1bf1-4d60-b9ba-c33aee299110 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:53.482968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5642ef0d-1bf1-4d60-b9ba-c33aee299110 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:53.484237 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5642ef0d-1bf1-4d60-b9ba-c33aee299110 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1670 microversion: 2.20 time: 0.174770 Jun 16 19:02:53.484805 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 424/882] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:53 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:53.663748 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6265fffd-8cb0-4162-8fb5-deec430bccf6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:53.669767 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6265fffd-8cb0-4162-8fb5-deec430bccf6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:53.670899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6265fffd-8cb0-4162-8fb5-deec430bccf6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.671351 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6265fffd-8cb0-4162-8fb5-deec430bccf6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.672200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6265fffd-8cb0-4162-8fb5-deec430bccf6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.672639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6265fffd-8cb0-4162-8fb5-deec430bccf6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.707179 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6265fffd-8cb0-4162-8fb5-deec430bccf6 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047456 Jun 16 19:02:53.708065 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 459/883] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:02:53 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:02:53.814064 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-23b85bb2-c60b-4af9-9061-b53a42b5e850 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:53.815121 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-23b85bb2-c60b-4af9-9061-b53a42b5e850 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:53.822278 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-23b85bb2-c60b-4af9-9061-b53a42b5e850 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.822737 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-23b85bb2-c60b-4af9-9061-b53a42b5e850 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.823521 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-23b85bb2-c60b-4af9-9061-b53a42b5e850 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.823964 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-23b85bb2-c60b-4af9-9061-b53a42b5e850 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.854714 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-23b85bb2-c60b-4af9-9061-b53a42b5e850 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044484 Jun 16 19:02:53.855281 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 425/884] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:02:53 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:02:53.922432 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8580f131-b326-4a18-9a77-6e572d1f40ea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:53.923007 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8580f131-b326-4a18-9a77-6e572d1f40ea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:53.929597 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8580f131-b326-4a18-9a77-6e572d1f40ea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.930042 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8580f131-b326-4a18-9a77-6e572d1f40ea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.930813 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8580f131-b326-4a18-9a77-6e572d1f40ea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.931853 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8580f131-b326-4a18-9a77-6e572d1f40ea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.960209 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8580f131-b326-4a18-9a77-6e572d1f40ea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Going to try to terminate instance {{(pid=130229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:02:54.353577 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8580f131-b326-4a18-9a77-6e572d1f40ea tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "DELETE /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 204 len: 0 microversion: 2.1 time: 0.432490 Jun 16 19:02:54.353577 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 460/885] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:02:53 2022] DELETE /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:02:54.361664 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2d4fb370-555a-468a-9d1d-f3a6af1490eb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:54.362290 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2d4fb370-555a-468a-9d1d-f3a6af1490eb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:54.368813 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2d4fb370-555a-468a-9d1d-f3a6af1490eb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:54.369299 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2d4fb370-555a-468a-9d1d-f3a6af1490eb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:54.370092 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2d4fb370-555a-468a-9d1d-f3a6af1490eb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:54.370537 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2d4fb370-555a-468a-9d1d-f3a6af1490eb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:54.500266 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2d4fb370-555a-468a-9d1d-f3a6af1490eb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:54.503467 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d34e0630-02ab-4363-80eb-aff821b8c5ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:54.504179 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d34e0630-02ab-4363-80eb-aff821b8c5ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:54.508547 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2d4fb370-555a-468a-9d1d-f3a6af1490eb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1674 microversion: 2.1 time: 0.150726 Jun 16 19:02:54.509124 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 426/886] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:54 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:54.514002 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d34e0630-02ab-4363-80eb-aff821b8c5ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:54.514459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d34e0630-02ab-4363-80eb-aff821b8c5ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:54.515236 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d34e0630-02ab-4363-80eb-aff821b8c5ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:54.515675 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d34e0630-02ab-4363-80eb-aff821b8c5ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:54.873914 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d34e0630-02ab-4363-80eb-aff821b8c5ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:54.882178 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d34e0630-02ab-4363-80eb-aff821b8c5ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:54.883779 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d34e0630-02ab-4363-80eb-aff821b8c5ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:54.885470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d34e0630-02ab-4363-80eb-aff821b8c5ff tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1670 microversion: 2.20 time: 0.386536 Jun 16 19:02:54.886027 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 461/887] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:54 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1670 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:55.526160 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-19d2b72b-d14d-44d6-84a4-41716a8c9b22 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:55.526811 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-19d2b72b-d14d-44d6-84a4-41716a8c9b22 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:55.533592 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-19d2b72b-d14d-44d6-84a4-41716a8c9b22 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:55.534053 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-19d2b72b-d14d-44d6-84a4-41716a8c9b22 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:55.534874 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-19d2b72b-d14d-44d6-84a4-41716a8c9b22 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:55.535314 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-19d2b72b-d14d-44d6-84a4-41716a8c9b22 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:55.669376 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-19d2b72b-d14d-44d6-84a4-41716a8c9b22 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:55.677631 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-19d2b72b-d14d-44d6-84a4-41716a8c9b22 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1674 microversion: 2.1 time: 0.155423 Jun 16 19:02:55.678179 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 427/888] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:55 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:55.904264 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-056011ab-b06a-45eb-978c-07b25fd546e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:55.904830 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-056011ab-b06a-45eb-978c-07b25fd546e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:55.910930 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-056011ab-b06a-45eb-978c-07b25fd546e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:55.911371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-056011ab-b06a-45eb-978c-07b25fd546e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:55.912119 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-056011ab-b06a-45eb-978c-07b25fd546e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:55.912547 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-056011ab-b06a-45eb-978c-07b25fd546e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:56.054328 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-056011ab-b06a-45eb-978c-07b25fd546e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:56.062342 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-056011ab-b06a-45eb-978c-07b25fd546e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:56.063948 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-056011ab-b06a-45eb-978c-07b25fd546e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:56.065110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-056011ab-b06a-45eb-978c-07b25fd546e2 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1670 microversion: 2.20 time: 0.165349 Jun 16 19:02:56.065693 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 462/889] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:55 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:56.695373 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-583707f2-948c-4e4d-8c47-fdbf09beaf65 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:56.696134 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-583707f2-948c-4e4d-8c47-fdbf09beaf65 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:56.703461 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-583707f2-948c-4e4d-8c47-fdbf09beaf65 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:56.703921 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-583707f2-948c-4e4d-8c47-fdbf09beaf65 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:56.704696 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-583707f2-948c-4e4d-8c47-fdbf09beaf65 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:56.705141 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-583707f2-948c-4e4d-8c47-fdbf09beaf65 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:56.966324 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-583707f2-948c-4e4d-8c47-fdbf09beaf65 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:56.974293 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-583707f2-948c-4e4d-8c47-fdbf09beaf65 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1674 microversion: 2.1 time: 0.282797 Jun 16 19:02:56.974874 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 428/890] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:56 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1674 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:57.082821 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-10c86906-81d9-4a49-b356-379f756d045b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:57.083501 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-10c86906-81d9-4a49-b356-379f756d045b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:57.090816 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10c86906-81d9-4a49-b356-379f756d045b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:57.091261 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10c86906-81d9-4a49-b356-379f756d045b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:57.092220 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10c86906-81d9-4a49-b356-379f756d045b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:57.092660 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-10c86906-81d9-4a49-b356-379f756d045b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:57.095410 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:57.400540 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-10c86906-81d9-4a49-b356-379f756d045b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:57.414297 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-10c86906-81d9-4a49-b356-379f756d045b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:57.415917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-10c86906-81d9-4a49-b356-379f756d045b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:57.417328 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-10c86906-81d9-4a49-b356-379f756d045b tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1728 microversion: 2.20 time: 0.338414 Jun 16 19:02:57.418190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 463/891] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:57 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1728 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:57.498344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-eea59350-8b32-4456-93ea-3273a7bc1cc1 req-e940ae36-abc1-409d-93fe-b616256b0f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "effe0963-698f-48d6-adf3-6b53bf88e09c", "name": "network-vif-deleted", "tag": "883851d6-ca58-4dd2-9dcf-af84a9421688"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:57.508114 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-eea59350-8b32-4456-93ea-3273a7bc1cc1 req-e940ae36-abc1-409d-93fe-b616256b0f8b service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:57.510109 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-eea59350-8b32-4456-93ea-3273a7bc1cc1 req-e940ae36-abc1-409d-93fe-b616256b0f8b service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:57.522571 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-eea59350-8b32-4456-93ea-3273a7bc1cc1 req-e940ae36-abc1-409d-93fe-b616256b0f8b service nova] Creating event network-vif-deleted:883851d6-ca58-4dd2-9dcf-af84a9421688 for instance effe0963-698f-48d6-adf3-6b53bf88e09c on hv-cinder-84617 Jun 16 19:02:57.529305 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-eea59350-8b32-4456-93ea-3273a7bc1cc1 req-e940ae36-abc1-409d-93fe-b616256b0f8b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035771 Jun 16 19:02:57.529987 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 429/892] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:57.990427 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1729b81e-a585-44e3-ba11-2c5db1cfa7fb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:57.991151 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-1729b81e-a585-44e3-ba11-2c5db1cfa7fb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:57.998448 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1729b81e-a585-44e3-ba11-2c5db1cfa7fb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:57.999393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1729b81e-a585-44e3-ba11-2c5db1cfa7fb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:58.000252 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1729b81e-a585-44e3-ba11-2c5db1cfa7fb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:58.000954 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1729b81e-a585-44e3-ba11-2c5db1cfa7fb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:58.039656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1729b81e-a585-44e3-ba11-2c5db1cfa7fb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:58.040107 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1729b81e-a585-44e3-ba11-2c5db1cfa7fb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:58.041389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-1729b81e-a585-44e3-ba11-2c5db1cfa7fb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lazy-loading 'fault' on Instance uuid effe0963-698f-48d6-adf3-6b53bf88e09c {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:02:58.103052 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1729b81e-a585-44e3-ba11-2c5db1cfa7fb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec4e3ac2e44403b9d45b37b5a6f64a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9e5f71068aa4d75bcc4578b741f490d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:58.108055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-1729b81e-a585-44e3-ba11-2c5db1cfa7fb tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 200 len: 1328 microversion: 2.1 time: 0.121459 Jun 16 19:02:58.108737 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 464/893] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:57 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 1328 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:58.437895 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-8c2f442c-b8f5-4885-894e-c78c22ef4fed tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:58.439161 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-8c2f442c-b8f5-4885-894e-c78c22ef4fed tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:58.448647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8c2f442c-b8f5-4885-894e-c78c22ef4fed tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:58.449102 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8c2f442c-b8f5-4885-894e-c78c22ef4fed tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:58.449930 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8c2f442c-b8f5-4885-894e-c78c22ef4fed tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:58.450358 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8c2f442c-b8f5-4885-894e-c78c22ef4fed tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:58.669412 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8c2f442c-b8f5-4885-894e-c78c22ef4fed tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:58.681823 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8c2f442c-b8f5-4885-894e-c78c22ef4fed tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:58.701552 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8c2f442c-b8f5-4885-894e-c78c22ef4fed tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:58.701552 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-8c2f442c-b8f5-4885-894e-c78c22ef4fed tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1728 microversion: 2.20 time: 0.264220 Jun 16 19:02:58.701552 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 430/894] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:58 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1728 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:59.125365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8d772fee-9786-412c-89ef-bf3cf14d418f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:59.126237 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8d772fee-9786-412c-89ef-bf3cf14d418f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:59.133449 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8d772fee-9786-412c-89ef-bf3cf14d418f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:59.133982 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8d772fee-9786-412c-89ef-bf3cf14d418f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:59.135507 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8d772fee-9786-412c-89ef-bf3cf14d418f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:59.136001 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8d772fee-9786-412c-89ef-bf3cf14d418f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:59.155411 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-8d772fee-9786-412c-89ef-bf3cf14d418f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] HTTP exception thrown: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8d772fee-9786-412c-89ef-bf3cf14d418f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Request method failure captured: Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c HTTP/1.1 Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq3y-peb9hOQgKqy82HgS0nRjwmQuBBnzkVB0txQ1FbbOtziHrwoSK52YxVh5Y-SxGpqEAnPvpoQKaHh368vbacMjaCiVwbtx8CfjlLfjbun_AYqpEXGeprB7XVw3hLwzU47hRfbXRNYpcz01KVv-7UM0lb9tNreDwFbQPk4MsAc457E Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: f9e5f71068aa4d75bcc4578b741f490d Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:02:59.157514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:02:59.169355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f9e5f71068aa4d75bcc4578b741f490d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f9e5f71068aa4d75bcc4578b741f490d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f9e5f71068aa4d75bcc4578b741f490d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f9e5f71068aa4d75bcc4578b741f490d"}]}] Jun 16 19:02:59.169355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:02:59.169355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: f9e5f71068aa4d75bcc4578b741f490d Jun 16 19:02:59.169355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:02:59.169355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-AttachVolumeTestJSON-630145281-project Jun 16 19:02:59.169355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:02:59.169355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:02:59.169355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: fec4e3ac2e44403b9d45b37b5a6f64a9 Jun 16 19:02:59.169355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-AttachVolumeTestJSON-630145281-project Jun 16 19:02:59.169355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:02:59.169355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. Jun 16 19:02:59.169355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': 'effe0963-698f-48d6-adf3-6b53bf88e09c'} Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:02:59.170430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. Jun 16 19:02:59.172149 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:02:59.173544 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8d772fee-9786-412c-89ef-bf3cf14d418f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Returning 404 to user: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:02:59.173544 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8d772fee-9786-412c-89ef-bf3cf14d418f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 404 len: 111 microversion: 2.1 time: 0.038207 Jun 16 19:02:59.173544 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 465/895] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:59 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:02:59.173795 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9c112041-e5b1-4e4b-aad8-db31f6df06ae tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '.version_select at 0x7f2007f43700>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:59.242216 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9c112041-e5b1-4e4b-aad8-db31f6df06ae tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415332267" status: 202 len: 0 microversion: 2.1 time: 0.077397 Jun 16 19:02:59.242819 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 431/896] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jun 16 19:02:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1415332267 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:02:59.718243 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d1f144c8-ff22-4223-9b99-659011f9991f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:59.719274 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d1f144c8-ff22-4223-9b99-659011f9991f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:59.725656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d1f144c8-ff22-4223-9b99-659011f9991f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:59.726106 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d1f144c8-ff22-4223-9b99-659011f9991f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:59.727082 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d1f144c8-ff22-4223-9b99-659011f9991f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:59.727684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d1f144c8-ff22-4223-9b99-659011f9991f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:00.005052 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d1f144c8-ff22-4223-9b99-659011f9991f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:00.021666 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d1f144c8-ff22-4223-9b99-659011f9991f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:00.035170 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d1f144c8-ff22-4223-9b99-659011f9991f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:00.036684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d1f144c8-ff22-4223-9b99-659011f9991f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1728 microversion: 2.20 time: 0.322560 Jun 16 19:03:00.037514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 466/897] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:59 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1728 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:01.056167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-246e6673-5832-462e-b564-286e0bb51c0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:01.057569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-246e6673-5832-462e-b564-286e0bb51c0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:01.064517 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-246e6673-5832-462e-b564-286e0bb51c0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:01.064960 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-246e6673-5832-462e-b564-286e0bb51c0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:01.065828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-246e6673-5832-462e-b564-286e0bb51c0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:01.066261 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-246e6673-5832-462e-b564-286e0bb51c0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:01.210906 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-246e6673-5832-462e-b564-286e0bb51c0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:01.219490 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-246e6673-5832-462e-b564-286e0bb51c0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:01.221152 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-246e6673-5832-462e-b564-286e0bb51c0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:01.222473 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-246e6673-5832-462e-b564-286e0bb51c0a tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1728 microversion: 2.20 time: 0.170635 Jun 16 19:03:01.223145 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 432/898] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:01 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:02.240021 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-78c68c74-0c8f-4a2d-a577-612efdfa09af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:02.240874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-78c68c74-0c8f-4a2d-a577-612efdfa09af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:02.247899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-78c68c74-0c8f-4a2d-a577-612efdfa09af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:02.248341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-78c68c74-0c8f-4a2d-a577-612efdfa09af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:02.249336 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-78c68c74-0c8f-4a2d-a577-612efdfa09af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:02.249773 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-78c68c74-0c8f-4a2d-a577-612efdfa09af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:02.410603 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-78c68c74-0c8f-4a2d-a577-612efdfa09af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:02.418757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-78c68c74-0c8f-4a2d-a577-612efdfa09af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:02.420675 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-78c68c74-0c8f-4a2d-a577-612efdfa09af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:02.422056 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-78c68c74-0c8f-4a2d-a577-612efdfa09af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1728 microversion: 2.20 time: 0.186050 Jun 16 19:03:02.422769 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 467/899] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:02 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:03.440314 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-31a98f56-26fc-4bab-b2ec-53cf82281b82 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:03.441603 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-31a98f56-26fc-4bab-b2ec-53cf82281b82 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:03.448628 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-31a98f56-26fc-4bab-b2ec-53cf82281b82 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:03.449078 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-31a98f56-26fc-4bab-b2ec-53cf82281b82 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:03.449888 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-31a98f56-26fc-4bab-b2ec-53cf82281b82 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:03.450324 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-31a98f56-26fc-4bab-b2ec-53cf82281b82 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:03.601100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-31a98f56-26fc-4bab-b2ec-53cf82281b82 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:03.610791 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-31a98f56-26fc-4bab-b2ec-53cf82281b82 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:03.612257 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-31a98f56-26fc-4bab-b2ec-53cf82281b82 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:03.613482 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-31a98f56-26fc-4bab-b2ec-53cf82281b82 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1728 microversion: 2.20 time: 0.177220 Jun 16 19:03:03.614425 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 433/900] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:03 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:04.632226 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-dfe8b7d4-e3bf-4b6e-b7f0-86364539be19 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:04.633481 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-dfe8b7d4-e3bf-4b6e-b7f0-86364539be19 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:04.640060 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dfe8b7d4-e3bf-4b6e-b7f0-86364539be19 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:04.640653 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dfe8b7d4-e3bf-4b6e-b7f0-86364539be19 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:04.641613 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dfe8b7d4-e3bf-4b6e-b7f0-86364539be19 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:04.642205 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dfe8b7d4-e3bf-4b6e-b7f0-86364539be19 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:04.789570 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-dfe8b7d4-e3bf-4b6e-b7f0-86364539be19 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:04.797746 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-dfe8b7d4-e3bf-4b6e-b7f0-86364539be19 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:04.799262 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-dfe8b7d4-e3bf-4b6e-b7f0-86364539be19 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:04.800435 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-dfe8b7d4-e3bf-4b6e-b7f0-86364539be19 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1728 microversion: 2.20 time: 0.172237 Jun 16 19:03:04.800996 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 468/901] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:04 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:04.969168 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c12474a7-fbc3-4ff7-a386-ea210ffc58db tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:04.969721 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-c12474a7-fbc3-4ff7-a386-ea210ffc58db tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:04.985050 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c12474a7-fbc3-4ff7-a386-ea210ffc58db tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:04.985539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c12474a7-fbc3-4ff7-a386-ea210ffc58db tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:04.986318 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c12474a7-fbc3-4ff7-a386-ea210ffc58db tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:04.986755 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c12474a7-fbc3-4ff7-a386-ea210ffc58db tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-c12474a7-fbc3-4ff7-a386-ea210ffc58db tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] HTTP exception thrown: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c12474a7-fbc3-4ff7-a386-ea210ffc58db tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Request method failure captured: Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: DELETE /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c HTTP/1.1 Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq3y-peb9hOQgKqy82HgS0nRjwmQuBBnzkVB0txQ1FbbOtziHrwoSK52YxVh5Y-SxGpqEAnPvpoQKaHh368vbacMjaCiVwbtx8CfjlLfjbun_AYqpEXGeprB7XVw3hLwzU47hRfbXRNYpcz01KVv-7UM0lb9tNreDwFbQPk4MsAc457E Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: f9e5f71068aa4d75bcc4578b741f490d Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:03:05.037498 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:03:05.040211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f9e5f71068aa4d75bcc4578b741f490d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f9e5f71068aa4d75bcc4578b741f490d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f9e5f71068aa4d75bcc4578b741f490d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f9e5f71068aa4d75bcc4578b741f490d"}]}] Jun 16 19:03:05.040211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:03:05.040211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: f9e5f71068aa4d75bcc4578b741f490d Jun 16 19:03:05.040211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:03:05.040211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-AttachVolumeTestJSON-630145281-project Jun 16 19:03:05.040211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:03:05.040211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:03:05.040211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: fec4e3ac2e44403b9d45b37b5a6f64a9 Jun 16 19:03:05.040211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-AttachVolumeTestJSON-630145281-project Jun 16 19:03:05.040211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:03:05.040211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. Jun 16 19:03:05.040211 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': 'effe0963-698f-48d6-adf3-6b53bf88e09c'} Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:05.042304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. Jun 16 19:03:05.044510 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:05.046370 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c12474a7-fbc3-4ff7-a386-ea210ffc58db tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Returning 404 to user: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:05.046370 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-c12474a7-fbc3-4ff7-a386-ea210ffc58db tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "DELETE /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 404 len: 111 microversion: 2.1 time: 0.045563 Jun 16 19:03:05.046370 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 434/902] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:03:04 2022] DELETE /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:03:05.046752 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f10980f1-4a47-48a0-8680-da7355848058 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:05.046752 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f10980f1-4a47-48a0-8680-da7355848058 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: effe0963-698f-48d6-adf3-6b53bf88e09c] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:05.046752 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f10980f1-4a47-48a0-8680-da7355848058 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:05.047022 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f10980f1-4a47-48a0-8680-da7355848058 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:05.047615 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f10980f1-4a47-48a0-8680-da7355848058 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:05.048077 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f10980f1-4a47-48a0-8680-da7355848058 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:05.070125 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-f10980f1-4a47-48a0-8680-da7355848058 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] HTTP exception thrown: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f10980f1-4a47-48a0-8680-da7355848058 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Request method failure captured: Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c HTTP/1.1 Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq3y-peb9hOQgKqy82HgS0nRjwmQuBBnzkVB0txQ1FbbOtziHrwoSK52YxVh5Y-SxGpqEAnPvpoQKaHh368vbacMjaCiVwbtx8CfjlLfjbun_AYqpEXGeprB7XVw3hLwzU47hRfbXRNYpcz01KVv-7UM0lb9tNreDwFbQPk4MsAc457E Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: f9e5f71068aa4d75bcc4578b741f490d Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:03:05.071667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:03:05.074110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f9e5f71068aa4d75bcc4578b741f490d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f9e5f71068aa4d75bcc4578b741f490d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f9e5f71068aa4d75bcc4578b741f490d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f9e5f71068aa4d75bcc4578b741f490d"}]}] Jun 16 19:03:05.074110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:03:05.074110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: f9e5f71068aa4d75bcc4578b741f490d Jun 16 19:03:05.074110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:03:05.074110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-AttachVolumeTestJSON-630145281-project Jun 16 19:03:05.074110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:03:05.074110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:03:05.074110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: fec4e3ac2e44403b9d45b37b5a6f64a9 Jun 16 19:03:05.074110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-AttachVolumeTestJSON-630145281-project Jun 16 19:03:05.074110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:03:05.074110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. Jun 16 19:03:05.074110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': 'effe0963-698f-48d6-adf3-6b53bf88e09c'} Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:05.075013 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. Jun 16 19:03:05.076990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:05.079555 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f10980f1-4a47-48a0-8680-da7355848058 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Returning 404 to user: Instance effe0963-698f-48d6-adf3-6b53bf88e09c could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:05.079555 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f10980f1-4a47-48a0-8680-da7355848058 tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c" status: 404 len: 111 microversion: 2.1 time: 0.042517 Jun 16 19:03:05.079555 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 469/903] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:05 2022] GET /compute/v2.1/servers/effe0963-698f-48d6-adf3-6b53bf88e09c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:03:05.819363 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a737027a-0829-4f21-ab6f-68413cc35e4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:05.819979 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a737027a-0829-4f21-ab6f-68413cc35e4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:05.832493 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a737027a-0829-4f21-ab6f-68413cc35e4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:05.833009 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a737027a-0829-4f21-ab6f-68413cc35e4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:05.834006 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a737027a-0829-4f21-ab6f-68413cc35e4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:05.834651 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a737027a-0829-4f21-ab6f-68413cc35e4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:06.005315 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a737027a-0829-4f21-ab6f-68413cc35e4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:06.012761 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a737027a-0829-4f21-ab6f-68413cc35e4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:06.014380 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a737027a-0829-4f21-ab6f-68413cc35e4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:06.015821 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a737027a-0829-4f21-ab6f-68413cc35e4f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1728 microversion: 2.20 time: 0.200271 Jun 16 19:03:06.016431 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 435/904] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:05 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1728 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:06.592635 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-2759a1fa-c38a-4c7b-a4c5-59d93aba3c6f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:06.593171 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-2759a1fa-c38a-4c7b-a4c5-59d93aba3c6f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:06.595474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:06.601448 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2759a1fa-c38a-4c7b-a4c5-59d93aba3c6f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:06.604394 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2759a1fa-c38a-4c7b-a4c5-59d93aba3c6f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:06.604394 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2759a1fa-c38a-4c7b-a4c5-59d93aba3c6f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:06.604394 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2759a1fa-c38a-4c7b-a4c5-59d93aba3c6f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:06.617363 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-2759a1fa-c38a-4c7b-a4c5-59d93aba3c6f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] HTTP exception thrown: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-2759a1fa-c38a-4c7b-a4c5-59d93aba3c6f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Request method failure captured: Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: DELETE /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 HTTP/1.1 Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq3y-peb9hOQgKqy82HgS0nRjwmQuBBnzkVB0txQ1FbbOtziHrwoSK52YxVh5Y-SxGpqEAnPvpoQKaHh368vbacMjaCiVwbtx8CfjlLfjbun_AYqpEXGeprB7XVw3hLwzU47hRfbXRNYpcz01KVv-7UM0lb9tNreDwFbQPk4MsAc457E Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: f9e5f71068aa4d75bcc4578b741f490d Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:03:06.618957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:03:06.620571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f9e5f71068aa4d75bcc4578b741f490d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f9e5f71068aa4d75bcc4578b741f490d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f9e5f71068aa4d75bcc4578b741f490d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f9e5f71068aa4d75bcc4578b741f490d"}]}] Jun 16 19:03:06.620571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:03:06.620571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: f9e5f71068aa4d75bcc4578b741f490d Jun 16 19:03:06.620571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:03:06.620571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-AttachVolumeTestJSON-630145281-project Jun 16 19:03:06.620571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:03:06.620571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:03:06.620571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: fec4e3ac2e44403b9d45b37b5a6f64a9 Jun 16 19:03:06.620571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-AttachVolumeTestJSON-630145281-project Jun 16 19:03:06.620571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:03:06.620571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. Jun 16 19:03:06.620571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': '8bad769d-1b62-4d0f-8491-bfae3997a525'} Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:06.621792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. Jun 16 19:03:06.623048 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:06.624995 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-2759a1fa-c38a-4c7b-a4c5-59d93aba3c6f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Returning 404 to user: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:06.624995 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-2759a1fa-c38a-4c7b-a4c5-59d93aba3c6f tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 404 len: 111 microversion: 2.1 time: 0.032391 Jun 16 19:03:06.624995 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 470/905] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:03:06 2022] DELETE /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:03:06.630563 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-03764b51-7160-495f-a30a-8fd1018c16fd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:06.631184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-03764b51-7160-495f-a30a-8fd1018c16fd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] [instance: 8bad769d-1b62-4d0f-8491-bfae3997a525] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:06.637432 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-03764b51-7160-495f-a30a-8fd1018c16fd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:06.637872 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-03764b51-7160-495f-a30a-8fd1018c16fd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:06.638740 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-03764b51-7160-495f-a30a-8fd1018c16fd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:06.639399 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-03764b51-7160-495f-a30a-8fd1018c16fd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:06.653808 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-03764b51-7160-495f-a30a-8fd1018c16fd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] HTTP exception thrown: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-03764b51-7160-495f-a30a-8fd1018c16fd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Request method failure captured: Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 HTTP/1.1 Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq3y-peb9hOQgKqy82HgS0nRjwmQuBBnzkVB0txQ1FbbOtziHrwoSK52YxVh5Y-SxGpqEAnPvpoQKaHh368vbacMjaCiVwbtx8CfjlLfjbun_AYqpEXGeprB7XVw3hLwzU47hRfbXRNYpcz01KVv-7UM0lb9tNreDwFbQPk4MsAc457E Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: f9e5f71068aa4d75bcc4578b741f490d Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:03:06.658767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:03:06.660137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f9e5f71068aa4d75bcc4578b741f490d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f9e5f71068aa4d75bcc4578b741f490d", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f9e5f71068aa4d75bcc4578b741f490d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f9e5f71068aa4d75bcc4578b741f490d"}]}] Jun 16 19:03:06.660137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:03:06.660137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: f9e5f71068aa4d75bcc4578b741f490d Jun 16 19:03:06.660137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-AttachVolumeTestJSON-630145281 Jun 16 19:03:06.660137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-AttachVolumeTestJSON-630145281-project Jun 16 19:03:06.660137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:03:06.660137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:03:06.660137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: fec4e3ac2e44403b9d45b37b5a6f64a9 Jun 16 19:03:06.660137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-AttachVolumeTestJSON-630145281-project Jun 16 19:03:06.660137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:03:06.660137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. Jun 16 19:03:06.660137 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': '8bad769d-1b62-4d0f-8491-bfae3997a525'} Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:06.660967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. Jun 16 19:03:06.662340 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:06.663481 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-03764b51-7160-495f-a30a-8fd1018c16fd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] Returning 404 to user: Instance 8bad769d-1b62-4d0f-8491-bfae3997a525 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:06.663481 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-03764b51-7160-495f-a30a-8fd1018c16fd tempest-AttachVolumeTestJSON-630145281 tempest-AttachVolumeTestJSON-630145281-project] 10.222.0.81 "GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525" status: 404 len: 111 microversion: 2.1 time: 0.030402 Jun 16 19:03:06.663481 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 436/906] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:06 2022] GET /compute/v2.1/servers/8bad769d-1b62-4d0f-8491-bfae3997a525 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:03:07.034024 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-47e0887f-a492-4580-80e7-a2914c9b7a7c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:07.034637 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-47e0887f-a492-4580-80e7-a2914c9b7a7c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:07.041330 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-47e0887f-a492-4580-80e7-a2914c9b7a7c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:07.041785 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-47e0887f-a492-4580-80e7-a2914c9b7a7c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:07.042565 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-47e0887f-a492-4580-80e7-a2914c9b7a7c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:07.043005 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-47e0887f-a492-4580-80e7-a2914c9b7a7c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:07.175376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-47e0887f-a492-4580-80e7-a2914c9b7a7c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:07.184671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-47e0887f-a492-4580-80e7-a2914c9b7a7c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:07.195799 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-47e0887f-a492-4580-80e7-a2914c9b7a7c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:07.195799 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-47e0887f-a492-4580-80e7-a2914c9b7a7c tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1728 microversion: 2.20 time: 0.157319 Jun 16 19:03:07.195799 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 471/907] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:07 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:08.206352 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3fbb0d85-c747-4bb0-a77b-f6682f6ab9ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:08.207271 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3fbb0d85-c747-4bb0-a77b-f6682f6ab9ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:08.214690 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3fbb0d85-c747-4bb0-a77b-f6682f6ab9ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:08.215144 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3fbb0d85-c747-4bb0-a77b-f6682f6ab9ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:08.215924 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3fbb0d85-c747-4bb0-a77b-f6682f6ab9ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:08.216362 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3fbb0d85-c747-4bb0-a77b-f6682f6ab9ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:08.383085 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-3fbb0d85-c747-4bb0-a77b-f6682f6ab9ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:08.393555 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-3fbb0d85-c747-4bb0-a77b-f6682f6ab9ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:08.395057 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-3fbb0d85-c747-4bb0-a77b-f6682f6ab9ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:08.396413 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3fbb0d85-c747-4bb0-a77b-f6682f6ab9ba tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1728 microversion: 2.20 time: 0.194048 Jun 16 19:03:08.396956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 437/908] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:08 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:09.415289 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a9f6e3d6-32f8-409e-8b6e-c105e648323f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:09.415920 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a9f6e3d6-32f8-409e-8b6e-c105e648323f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:09.422495 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a9f6e3d6-32f8-409e-8b6e-c105e648323f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:09.422949 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a9f6e3d6-32f8-409e-8b6e-c105e648323f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:09.423723 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a9f6e3d6-32f8-409e-8b6e-c105e648323f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:09.424160 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a9f6e3d6-32f8-409e-8b6e-c105e648323f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:09.624160 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a9f6e3d6-32f8-409e-8b6e-c105e648323f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:09.632552 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a9f6e3d6-32f8-409e-8b6e-c105e648323f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:09.634112 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a9f6e3d6-32f8-409e-8b6e-c105e648323f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:09.635885 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a9f6e3d6-32f8-409e-8b6e-c105e648323f tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1728 microversion: 2.20 time: 0.224001 Jun 16 19:03:09.636465 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 472/909] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:09 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:03:10.654617 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-cfa83e81-4426-493d-b0cc-633d0a198590 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:10.655330 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-cfa83e81-4426-493d-b0cc-633d0a198590 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:10.662636 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cfa83e81-4426-493d-b0cc-633d0a198590 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:10.663308 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cfa83e81-4426-493d-b0cc-633d0a198590 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:10.664401 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cfa83e81-4426-493d-b0cc-633d0a198590 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:10.664904 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cfa83e81-4426-493d-b0cc-633d0a198590 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:10.816029 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-cfa83e81-4426-493d-b0cc-633d0a198590 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:10.819624 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:INSERT=3,nova_cell1:SELECT=90 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:10.825465 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-cfa83e81-4426-493d-b0cc-633d0a198590 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:10.826353 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-ca88911d-18e4-456e-8711-e08685dbce42 req-fb2a674f-cf2e-4c49-ad4f-1daca8a623c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33ad0030-d602-4eda-932c-e5a9ff1a7339", "name": "network-vif-plugged", "status": "completed", "tag": "876dcbc0-6957-426a-86fc-525cbbd501e9"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:10.826924 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-cfa83e81-4426-493d-b0cc-633d0a198590 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:10.828127 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-cfa83e81-4426-493d-b0cc-633d0a198590 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1728 microversion: 2.20 time: 0.178566 Jun 16 19:03:10.828679 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 438/910] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:10 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:10.836309 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-ca88911d-18e4-456e-8711-e08685dbce42 req-fb2a674f-cf2e-4c49-ad4f-1daca8a623c0 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:10.836832 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-ca88911d-18e4-456e-8711-e08685dbce42 req-fb2a674f-cf2e-4c49-ad4f-1daca8a623c0 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:10.848104 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-ca88911d-18e4-456e-8711-e08685dbce42 req-fb2a674f-cf2e-4c49-ad4f-1daca8a623c0 service nova] Creating event network-vif-plugged:876dcbc0-6957-426a-86fc-525cbbd501e9 for instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 on hv-cinder-84617 Jun 16 19:03:10.853323 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-ca88911d-18e4-456e-8711-e08685dbce42 req-fb2a674f-cf2e-4c49-ad4f-1daca8a623c0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031433 Jun 16 19:03:10.854019 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 473/911] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:03:11.846273 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3cc93fa4-2d78-4a7f-b44b-930741925835 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:11.846826 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3cc93fa4-2d78-4a7f-b44b-930741925835 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:11.854765 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3cc93fa4-2d78-4a7f-b44b-930741925835 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:11.856389 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3cc93fa4-2d78-4a7f-b44b-930741925835 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:11.856389 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3cc93fa4-2d78-4a7f-b44b-930741925835 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:11.856389 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3cc93fa4-2d78-4a7f-b44b-930741925835 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:12.010657 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-3cc93fa4-2d78-4a7f-b44b-930741925835 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:12.020511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-3cc93fa4-2d78-4a7f-b44b-930741925835 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:12.022511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-3cc93fa4-2d78-4a7f-b44b-930741925835 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:12.023825 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3cc93fa4-2d78-4a7f-b44b-930741925835 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1728 microversion: 2.20 time: 0.181896 Jun 16 19:03:12.034111 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 439/912] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:11 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:13.045402 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-18992b3d-2508-4adc-a25d-9b429e20a611 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:13.046286 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-18992b3d-2508-4adc-a25d-9b429e20a611 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:13.052807 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-18992b3d-2508-4adc-a25d-9b429e20a611 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:13.053375 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-18992b3d-2508-4adc-a25d-9b429e20a611 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:13.054051 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-18992b3d-2508-4adc-a25d-9b429e20a611 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:13.054526 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-18992b3d-2508-4adc-a25d-9b429e20a611 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:13.203976 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-18992b3d-2508-4adc-a25d-9b429e20a611 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:13.214334 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-18992b3d-2508-4adc-a25d-9b429e20a611 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:13.215902 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-18992b3d-2508-4adc-a25d-9b429e20a611 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:13.217129 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-18992b3d-2508-4adc-a25d-9b429e20a611 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1728 microversion: 2.20 time: 0.178137 Jun 16 19:03:13.217714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 474/913] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:13 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:13.628173 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f9c33632-2f9b-48a7-86d2-fb7a0e96d135 tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Action: 'create', calling method: .version_select at 0x7f2007fbd4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1995811566", "metadata": {"Type": "work"}}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f9c33632-2f9b-48a7-86d2-fb7a0e96d135 tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Request method failure captured: Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 122 Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq35xRTPCqz8lR4HzVz0hQtMpO7V8nZslrPc3MWORjypCmtZdCMsbwIyK187Sq-fTc8FsBkwv4PmZDis8DrBK9f5f-VmNVmWDiQBnRCgKe9HIpPFPNhiqxkF6gXHgaK-e3sBN7s-5UBAocXyxNU86vVxWbHTGOYdPGtycWy5xMGkhAnk Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: fd982842e23d4e95975242444172c788 Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:03:13.652539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:03:13.654294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fd982842e23d4e95975242444172c788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_fd982842e23d4e95975242444172c788", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fd982842e23d4e95975242444172c788"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/fd982842e23d4e95975242444172c788"}]}] Jun 16 19:03:13.654294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.654294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: fd982842e23d4e95975242444172c788 Jun 16 19:03:13.654294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.654294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-VolumesNegativeTest-441594967-project Jun 16 19:03:13.654294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:03:13.654294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:03:13.654294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: b4fb7ebe1709482aa255346ecd1d1d7d Jun 16 19:03:13.654294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-VolumesNegativeTest-441594967-project Jun 16 19:03:13.654294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Jun 16 19:03:13.654294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1995811566", "metadata": {"Type": "work"}}} Jun 16 19:03:13.654294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: Jun 16 19:03:13.654294 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1995811566', 'metadata': {'Type': 'work'}}}} Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise error Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:13.656150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 19:03:13.658386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 19:03:13.659928 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 19:03:13.659928 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.659928 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f9c33632-2f9b-48a7-86d2-fb7a0e96d135 tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:13.659928 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f9c33632-2f9b-48a7-86d2-fb7a0e96d135 tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.161638 Jun 16 19:03:13.659928 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 440/914] 10.222.0.81 () {60 vars in 1155 bytes} [Thu Jun 16 19:03:13 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:03:13.665595 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1ebdc38e-317c-42fc-8aa9-42b4800cec0a tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Action: 'create', calling method: .version_select at 0x7f2018827b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1090359290", "metadata": {"Type": "work"}}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1ebdc38e-317c-42fc-8aa9-42b4800cec0a tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Request method failure captured: Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 120 Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq35xRTPCqz8lR4HzVz0hQtMpO7V8nZslrPc3MWORjypCmtZdCMsbwIyK187Sq-fTc8FsBkwv4PmZDis8DrBK9f5f-VmNVmWDiQBnRCgKe9HIpPFPNhiqxkF6gXHgaK-e3sBN7s-5UBAocXyxNU86vVxWbHTGOYdPGtycWy5xMGkhAnk Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: fd982842e23d4e95975242444172c788 Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:03:13.668955 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:03:13.670872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fd982842e23d4e95975242444172c788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_fd982842e23d4e95975242444172c788", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fd982842e23d4e95975242444172c788"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/fd982842e23d4e95975242444172c788"}]}] Jun 16 19:03:13.670872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.670872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: fd982842e23d4e95975242444172c788 Jun 16 19:03:13.670872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.670872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-VolumesNegativeTest-441594967-project Jun 16 19:03:13.670872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:03:13.670872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:03:13.670872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: b4fb7ebe1709482aa255346ecd1d1d7d Jun 16 19:03:13.670872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-VolumesNegativeTest-441594967-project Jun 16 19:03:13.670872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Jun 16 19:03:13.670872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1090359290", "metadata": {"Type": "work"}}} Jun 16 19:03:13.670872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: Jun 16 19:03:13.670872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1090359290', 'metadata': {'Type': 'work'}}}} Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise error Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi '0' Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:13.676454 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 19:03:13.678913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 19:03:13.680793 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 19:03:13.680793 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.680793 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1ebdc38e-317c-42fc-8aa9-42b4800cec0a tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:13.680793 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-1ebdc38e-317c-42fc-8aa9-42b4800cec0a tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008888 Jun 16 19:03:13.680793 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 475/915] 10.222.0.81 () {60 vars in 1155 bytes} [Thu Jun 16 19:03:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 19:03:13.684740 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-be36cd94-7fb5-4bc6-b191-8a5e091b3b2b tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Action: 'create', calling method: .version_select at 0x7f2007f51dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1408638376", "metadata": {"Type": "work"}}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-be36cd94-7fb5-4bc6-b191-8a5e091b3b2b tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Request method failure captured: Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 119 Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq35xRTPCqz8lR4HzVz0hQtMpO7V8nZslrPc3MWORjypCmtZdCMsbwIyK187Sq-fTc8FsBkwv4PmZDis8DrBK9f5f-VmNVmWDiQBnRCgKe9HIpPFPNhiqxkF6gXHgaK-e3sBN7s-5UBAocXyxNU86vVxWbHTGOYdPGtycWy5xMGkhAnk Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: fd982842e23d4e95975242444172c788 Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:03:13.687221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:03:13.688754 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fd982842e23d4e95975242444172c788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_fd982842e23d4e95975242444172c788", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fd982842e23d4e95975242444172c788"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/fd982842e23d4e95975242444172c788"}]}] Jun 16 19:03:13.688754 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.688754 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: fd982842e23d4e95975242444172c788 Jun 16 19:03:13.688754 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.688754 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-VolumesNegativeTest-441594967-project Jun 16 19:03:13.688754 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:03:13.688754 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:03:13.688754 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: b4fb7ebe1709482aa255346ecd1d1d7d Jun 16 19:03:13.688754 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-VolumesNegativeTest-441594967-project Jun 16 19:03:13.688754 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Jun 16 19:03:13.688754 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1408638376", "metadata": {"Type": "work"}}} Jun 16 19:03:13.688754 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: Jun 16 19:03:13.688754 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1408638376', 'metadata': {'Type': 'work'}}}} Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise error Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi '' Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:13.689940 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 19:03:13.691487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 19:03:13.694413 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 19:03:13.694413 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.694413 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-be36cd94-7fb5-4bc6-b191-8a5e091b3b2b tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:13.694413 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-be36cd94-7fb5-4bc6-b191-8a5e091b3b2b tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008096 Jun 16 19:03:13.694848 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 441/916] 10.222.0.81 () {60 vars in 1155 bytes} [Thu Jun 16 19:03:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:03:13.702152 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-be10ee08-c904-48ff-a501-23b51846d857 tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Calling method '.version_select at 0x7f20187eeb80>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:13.731114 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-be10ee08-c904-48ff-a501-23b51846d857 tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] HTTP exception thrown: Volume tempest-invalid-1352691922 could not be found. Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-be10ee08-c904-48ff-a501-23b51846d857 tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Request method failure captured: Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1352691922 HTTP/1.1 Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq35xRTPCqz8lR4HzVz0hQtMpO7V8nZslrPc3MWORjypCmtZdCMsbwIyK187Sq-fTc8FsBkwv4PmZDis8DrBK9f5f-VmNVmWDiQBnRCgKe9HIpPFPNhiqxkF6gXHgaK-e3sBN7s-5UBAocXyxNU86vVxWbHTGOYdPGtycWy5xMGkhAnk Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: fd982842e23d4e95975242444172c788 Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:03:13.733933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:03:13.735656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fd982842e23d4e95975242444172c788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_fd982842e23d4e95975242444172c788", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fd982842e23d4e95975242444172c788"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/fd982842e23d4e95975242444172c788"}]}] Jun 16 19:03:13.735656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.735656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: fd982842e23d4e95975242444172c788 Jun 16 19:03:13.735656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.735656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-VolumesNegativeTest-441594967-project Jun 16 19:03:13.735656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:03:13.735656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:03:13.735656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: b4fb7ebe1709482aa255346ecd1d1d7d Jun 16 19:03:13.735656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-VolumesNegativeTest-441594967-project Jun 16 19:03:13.735656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: Jun 16 19:03:13.735656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Volume tempest-invalid-1352691922 could not be found. Jun 16 19:03:13.735656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': 'tempest-invalid-1352691922'} Jun 16 19:03:13.735656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1352691922 could not be found. (HTTP 404) (Request-ID: req-7db72ffc-f317-4d16-bfe4-473d4837c682) Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:13.736757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:03:13.738242 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1352691922 could not be found. Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:03:13.739850 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1352691922 could not be found. Jun 16 19:03:13.741463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.741463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:13.741463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.741463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.741463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:13.741463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:13.741463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:03:13.741463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:03:13.741463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1352691922 could not be found. Jun 16 19:03:13.741463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.741463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-be10ee08-c904-48ff-a501-23b51846d857 tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Returning 404 to user: Volume tempest-invalid-1352691922 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:13.741463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-be10ee08-c904-48ff-a501-23b51846d857 tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1352691922" status: 404 len: 99 microversion: 2.1 time: 0.038120 Jun 16 19:03:13.741463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 476/917] 10.222.0.81 () {58 vars in 1217 bytes} [Thu Jun 16 19:03:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1352691922 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 19:03:13.746744 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-47b5f656-e89e-46a7-a290-83468f59beca tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005582 Jun 16 19:03:13.747251 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 442/918] 10.222.0.81 () {58 vars in 1139 bytes} [Thu Jun 16 19:03:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 16 19:03:13.756314 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f19f5827-063a-4f7d-9f81-8bb72af58b79 tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004159 Jun 16 19:03:13.760985 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 477/919] 10.222.0.81 () {58 vars in 1136 bytes} [Thu Jun 16 19:03:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 19:03:13.769355 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-bbe3eef7-70af-453b-bd15-ab660cc5355c tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Calling method '.version_select at 0x7f2007ff6d30>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:13.800777 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-bbe3eef7-70af-453b-bd15-ab660cc5355c tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] HTTP exception thrown: Volume 87e1c766-5569-4ddc-bd11-50f3363eb1e4 could not be found. Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-bbe3eef7-70af-453b-bd15-ab660cc5355c tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Request method failure captured: Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: DELETE /compute/v2.1/os-volumes/87e1c766-5569-4ddc-bd11-50f3363eb1e4 HTTP/1.1 Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq35xRTPCqz8lR4HzVz0hQtMpO7V8nZslrPc3MWORjypCmtZdCMsbwIyK187Sq-fTc8FsBkwv4PmZDis8DrBK9f5f-VmNVmWDiQBnRCgKe9HIpPFPNhiqxkF6gXHgaK-e3sBN7s-5UBAocXyxNU86vVxWbHTGOYdPGtycWy5xMGkhAnk Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: fd982842e23d4e95975242444172c788 Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:03:13.802232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:03:13.803796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fd982842e23d4e95975242444172c788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_fd982842e23d4e95975242444172c788", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fd982842e23d4e95975242444172c788"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/fd982842e23d4e95975242444172c788"}]}] Jun 16 19:03:13.803796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.803796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: fd982842e23d4e95975242444172c788 Jun 16 19:03:13.803796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.803796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-VolumesNegativeTest-441594967-project Jun 16 19:03:13.803796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:03:13.803796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:03:13.803796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: b4fb7ebe1709482aa255346ecd1d1d7d Jun 16 19:03:13.803796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-VolumesNegativeTest-441594967-project Jun 16 19:03:13.803796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: Jun 16 19:03:13.803796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Volume 87e1c766-5569-4ddc-bd11-50f3363eb1e4 could not be found. Jun 16 19:03:13.803796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': '87e1c766-5569-4ddc-bd11-50f3363eb1e4'} Jun 16 19:03:13.803796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87e1c766-5569-4ddc-bd11-50f3363eb1e4 could not be found. (HTTP 404) (Request-ID: req-6c9955c5-4dd0-4796-91bd-3f653f375ccd) Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:13.804763 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:03:13.806184 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87e1c766-5569-4ddc-bd11-50f3363eb1e4 could not be found. Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 19:03:13.808084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:03:13.809391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87e1c766-5569-4ddc-bd11-50f3363eb1e4 could not be found. Jun 16 19:03:13.809391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.809391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:13.809391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.809391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.809391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:13.809391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:13.809391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:03:13.809391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:03:13.809391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87e1c766-5569-4ddc-bd11-50f3363eb1e4 could not be found. Jun 16 19:03:13.809391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.809391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-bbe3eef7-70af-453b-bd15-ab660cc5355c tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Returning 404 to user: Volume 87e1c766-5569-4ddc-bd11-50f3363eb1e4 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:13.809391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-bbe3eef7-70af-453b-bd15-ab660cc5355c tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/87e1c766-5569-4ddc-bd11-50f3363eb1e4" status: 404 len: 109 microversion: 2.1 time: 0.038850 Jun 16 19:03:13.809391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 443/920] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jun 16 19:03:13 2022] DELETE /compute/v2.1/os-volumes/87e1c766-5569-4ddc-bd11-50f3363eb1e4 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:03:13.815237 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-30de467b-fe23-4a99-9678-06ab6013c4c4 tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Calling method '.version_select at 0x7f2018888670>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:13.844495 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-30de467b-fe23-4a99-9678-06ab6013c4c4 tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] HTTP exception thrown: Volume 200e88fb-6fe6-4ab8-b169-95d3c0ec43cd could not be found. Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-30de467b-fe23-4a99-9678-06ab6013c4c4 tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Request method failure captured: Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/os-volumes/200e88fb-6fe6-4ab8-b169-95d3c0ec43cd HTTP/1.1 Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq35xRTPCqz8lR4HzVz0hQtMpO7V8nZslrPc3MWORjypCmtZdCMsbwIyK187Sq-fTc8FsBkwv4PmZDis8DrBK9f5f-VmNVmWDiQBnRCgKe9HIpPFPNhiqxkF6gXHgaK-e3sBN7s-5UBAocXyxNU86vVxWbHTGOYdPGtycWy5xMGkhAnk Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: fd982842e23d4e95975242444172c788 Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:03:13.846470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:03:13.851376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fd982842e23d4e95975242444172c788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_fd982842e23d4e95975242444172c788", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fd982842e23d4e95975242444172c788"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/fd982842e23d4e95975242444172c788"}]}] Jun 16 19:03:13.851376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.851376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: fd982842e23d4e95975242444172c788 Jun 16 19:03:13.851376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-VolumesNegativeTest-441594967 Jun 16 19:03:13.851376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-VolumesNegativeTest-441594967-project Jun 16 19:03:13.851376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:03:13.851376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:03:13.851376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: b4fb7ebe1709482aa255346ecd1d1d7d Jun 16 19:03:13.851376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-VolumesNegativeTest-441594967-project Jun 16 19:03:13.851376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: Jun 16 19:03:13.851376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Volume 200e88fb-6fe6-4ab8-b169-95d3c0ec43cd could not be found. Jun 16 19:03:13.851376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': '200e88fb-6fe6-4ab8-b169-95d3c0ec43cd'} Jun 16 19:03:13.851376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 200e88fb-6fe6-4ab8-b169-95d3c0ec43cd could not be found. (HTTP 404) (Request-ID: req-8088cc27-7e2a-458b-a54b-2ec0f9ed89e0) Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:13.852190 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:03:13.853446 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 200e88fb-6fe6-4ab8-b169-95d3c0ec43cd could not be found. Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 19:03:13.854856 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:03:13.856221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 200e88fb-6fe6-4ab8-b169-95d3c0ec43cd could not be found. Jun 16 19:03:13.856221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.856221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:13.856221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.856221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:13.856221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:13.856221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:13.856221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:03:13.856221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:03:13.856221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 200e88fb-6fe6-4ab8-b169-95d3c0ec43cd could not be found. Jun 16 19:03:13.856221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:13.856221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-30de467b-fe23-4a99-9678-06ab6013c4c4 tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] Returning 404 to user: Volume 200e88fb-6fe6-4ab8-b169-95d3c0ec43cd could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:13.856221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-30de467b-fe23-4a99-9678-06ab6013c4c4 tempest-VolumesNegativeTest-441594967 tempest-VolumesNegativeTest-441594967-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/200e88fb-6fe6-4ab8-b169-95d3c0ec43cd" status: 404 len: 109 microversion: 2.1 time: 0.036493 Jun 16 19:03:13.856221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 478/921] 10.222.0.81 () {58 vars in 1244 bytes} [Thu Jun 16 19:03:13 2022] GET /compute/v2.1/os-volumes/200e88fb-6fe6-4ab8-b169-95d3c0ec43cd => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:03:14.235341 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e84b2760-c526-4c46-9bda-8360335a3189 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:14.236062 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e84b2760-c526-4c46-9bda-8360335a3189 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:14.240006 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:14.244453 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e84b2760-c526-4c46-9bda-8360335a3189 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:14.245150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e84b2760-c526-4c46-9bda-8360335a3189 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:14.245958 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e84b2760-c526-4c46-9bda-8360335a3189 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:14.246569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e84b2760-c526-4c46-9bda-8360335a3189 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:14.419264 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e84b2760-c526-4c46-9bda-8360335a3189 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:14.428201 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e84b2760-c526-4c46-9bda-8360335a3189 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:14.429945 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e84b2760-c526-4c46-9bda-8360335a3189 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:14.432361 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e84b2760-c526-4c46-9bda-8360335a3189 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1728 microversion: 2.20 time: 0.199824 Jun 16 19:03:14.432361 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 444/922] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:14 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1728 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:15.453148 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-76a82c0d-5fa6-4e67-917d-bface77d8458 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:15.453148 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-76a82c0d-5fa6-4e67-917d-bface77d8458 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:15.458445 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-76a82c0d-5fa6-4e67-917d-bface77d8458 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:15.458994 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-76a82c0d-5fa6-4e67-917d-bface77d8458 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:15.460059 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-76a82c0d-5fa6-4e67-917d-bface77d8458 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:15.460570 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-76a82c0d-5fa6-4e67-917d-bface77d8458 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:15.518606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9735aa0a-0f7b-4855-8f38-c448ca1f99a7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:15.519263 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9735aa0a-0f7b-4855-8f38-c448ca1f99a7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:15.531195 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9735aa0a-0f7b-4855-8f38-c448ca1f99a7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:15.531653 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9735aa0a-0f7b-4855-8f38-c448ca1f99a7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:15.532442 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9735aa0a-0f7b-4855-8f38-c448ca1f99a7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:15.532883 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9735aa0a-0f7b-4855-8f38-c448ca1f99a7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:15.561474 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9735aa0a-0f7b-4855-8f38-c448ca1f99a7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Going to try to terminate instance {{(pid=130230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:03:15.633550 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-76a82c0d-5fa6-4e67-917d-bface77d8458 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:15.641756 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-76a82c0d-5fa6-4e67-917d-bface77d8458 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:15.643377 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-76a82c0d-5fa6-4e67-917d-bface77d8458 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:15.644857 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-76a82c0d-5fa6-4e67-917d-bface77d8458 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1715 microversion: 2.20 time: 0.199242 Jun 16 19:03:15.645745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 479/923] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:15 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1715 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:15.887292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-0d4392b0-3a23-42ac-8e6c-4c04aff89d7c req-f2b7236a-cf3f-48e2-acb2-4b98382a418c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf1ba63-bf52-412b-9948-409dadbbdf18", "tag": "9d682d40-5577-43db-823b-b6e4729f33b7"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:15.896613 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-0d4392b0-3a23-42ac-8e6c-4c04aff89d7c req-f2b7236a-cf3f-48e2-acb2-4b98382a418c service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:15.897063 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-0d4392b0-3a23-42ac-8e6c-4c04aff89d7c req-f2b7236a-cf3f-48e2-acb2-4b98382a418c service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:15.904981 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9735aa0a-0f7b-4855-8f38-c448ca1f99a7 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "DELETE /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 204 len: 0 microversion: 2.1 time: 0.390193 Jun 16 19:03:15.905707 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 445/924] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:03:15 2022] DELETE /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:03:15.914158 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-bb254033-c669-482d-8ba1-378ed36d867a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:15.914863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-bb254033-c669-482d-8ba1-378ed36d867a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:15.923344 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-0d4392b0-3a23-42ac-8e6c-4c04aff89d7c req-f2b7236a-cf3f-48e2-acb2-4b98382a418c service nova] Creating event network-changed:9d682d40-5577-43db-823b-b6e4729f33b7 for instance 5bf1ba63-bf52-412b-9948-409dadbbdf18 on hv-cinder-84617 Jun 16 19:03:15.930677 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bb254033-c669-482d-8ba1-378ed36d867a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:15.931193 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bb254033-c669-482d-8ba1-378ed36d867a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:15.931921 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bb254033-c669-482d-8ba1-378ed36d867a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:15.932390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bb254033-c669-482d-8ba1-378ed36d867a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:15.943691 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-0d4392b0-3a23-42ac-8e6c-4c04aff89d7c req-f2b7236a-cf3f-48e2-acb2-4b98382a418c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.295228 Jun 16 19:03:15.944432 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 480/925] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:03:16.087944 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-bb254033-c669-482d-8ba1-378ed36d867a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:16.096449 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-bb254033-c669-482d-8ba1-378ed36d867a tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1568 microversion: 2.1 time: 0.186400 Jun 16 19:03:16.107696 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 446/926] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:15 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:17.115492 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-56761f5c-a57b-4438-b1eb-7afa3660e8d0 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:17.116280 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-56761f5c-a57b-4438-b1eb-7afa3660e8d0 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:17.123337 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-56761f5c-a57b-4438-b1eb-7afa3660e8d0 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:17.123792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-56761f5c-a57b-4438-b1eb-7afa3660e8d0 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:17.124633 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-56761f5c-a57b-4438-b1eb-7afa3660e8d0 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:17.125296 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-56761f5c-a57b-4438-b1eb-7afa3660e8d0 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:17.295007 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-56761f5c-a57b-4438-b1eb-7afa3660e8d0 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:17.303450 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-56761f5c-a57b-4438-b1eb-7afa3660e8d0 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1568 microversion: 2.1 time: 0.192501 Jun 16 19:03:17.304025 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 481/927] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:17 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:18.321151 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9b70b437-5983-4a00-8887-1bfc9462788d tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:18.321801 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9b70b437-5983-4a00-8887-1bfc9462788d tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:18.329299 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9b70b437-5983-4a00-8887-1bfc9462788d tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:18.329752 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9b70b437-5983-4a00-8887-1bfc9462788d tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:18.330530 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9b70b437-5983-4a00-8887-1bfc9462788d tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:18.330980 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9b70b437-5983-4a00-8887-1bfc9462788d tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:18.443322 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9b70b437-5983-4a00-8887-1bfc9462788d tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:18.443769 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9b70b437-5983-4a00-8887-1bfc9462788d tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1382 microversion: 2.1 time: 0.126367 Jun 16 19:03:18.444358 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 447/928] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:18 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1382 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:18.471982 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-74c086ef-01b3-43ae-9164-7d1726b93774 req-ae3c1434-1dde-455a-9924-76558c71e323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf1ba63-bf52-412b-9948-409dadbbdf18", "name": "network-vif-deleted", "tag": "9d682d40-5577-43db-823b-b6e4729f33b7"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:18.481046 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-74c086ef-01b3-43ae-9164-7d1726b93774 req-ae3c1434-1dde-455a-9924-76558c71e323 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:18.481653 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-74c086ef-01b3-43ae-9164-7d1726b93774 req-ae3c1434-1dde-455a-9924-76558c71e323 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:18.492761 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-74c086ef-01b3-43ae-9164-7d1726b93774 req-ae3c1434-1dde-455a-9924-76558c71e323 service nova] Creating event network-vif-deleted:9d682d40-5577-43db-823b-b6e4729f33b7 for instance 5bf1ba63-bf52-412b-9948-409dadbbdf18 on hv-cinder-84617 Jun 16 19:03:18.499642 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-74c086ef-01b3-43ae-9164-7d1726b93774 req-ae3c1434-1dde-455a-9924-76558c71e323 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031278 Jun 16 19:03:18.500241 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 482/929] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:03:19.461592 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9c55ba32-31af-4dde-8b68-012d61bf6e2c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:19.462221 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9c55ba32-31af-4dde-8b68-012d61bf6e2c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:19.470205 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c55ba32-31af-4dde-8b68-012d61bf6e2c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:19.470590 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c55ba32-31af-4dde-8b68-012d61bf6e2c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:19.471382 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c55ba32-31af-4dde-8b68-012d61bf6e2c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:19.471817 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c55ba32-31af-4dde-8b68-012d61bf6e2c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:19.503485 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c55ba32-31af-4dde-8b68-012d61bf6e2c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:19.504077 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c55ba32-31af-4dde-8b68-012d61bf6e2c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:19.504523 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.objects.instance [None req-9c55ba32-31af-4dde-8b68-012d61bf6e2c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lazy-loading 'fault' on Instance uuid 5bf1ba63-bf52-412b-9948-409dadbbdf18 {{(pid=130230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:03:19.548247 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9c55ba32-31af-4dde-8b68-012d61bf6e2c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0569765b6f07473fa07a5376b3677da8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db8d64fab0e45ffbba87b1ae3b48703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:19.556801 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9c55ba32-31af-4dde-8b68-012d61bf6e2c tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 200 len: 1224 microversion: 2.1 time: 0.099106 Jun 16 19:03:19.557917 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 448/930] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:19 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:20.575041 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-bf6b14d2-6815-4bf8-8849-9f5b3596f434 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:20.575781 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-bf6b14d2-6815-4bf8-8849-9f5b3596f434 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] [instance: 5bf1ba63-bf52-412b-9948-409dadbbdf18] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:20.582376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bf6b14d2-6815-4bf8-8849-9f5b3596f434 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:20.582525 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bf6b14d2-6815-4bf8-8849-9f5b3596f434 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:20.583257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bf6b14d2-6815-4bf8-8849-9f5b3596f434 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:20.583714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-bf6b14d2-6815-4bf8-8849-9f5b3596f434 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:20.598158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-bf6b14d2-6815-4bf8-8849-9f5b3596f434 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] HTTP exception thrown: Instance 5bf1ba63-bf52-412b-9948-409dadbbdf18 could not be found. Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-bf6b14d2-6815-4bf8-8849-9f5b3596f434 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Request method failure captured: Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 HTTP/1.1 Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq30cRUXw30A_SHsqcNennajqOmBAWyW-IJF4wdgC9WL34JMyOFE5bSRg5Z4bd-9qVQUz29P1wAG_JSjMRaqnyy_iizpVlkXqBnh8auRl-ZlREaUFdlVp2qXUMzCMirQKEBwnqGOD0AeSOx7LKBk8kFw_a_wgKgnxgGNRyxR4tYmzP8s Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: 5db8d64fab0e45ffbba87b1ae3b48703 Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-TestShelveInstance-1359640481 Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:03:20.599874 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:03:20.601440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5db8d64fab0e45ffbba87b1ae3b48703"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_5db8d64fab0e45ffbba87b1ae3b48703", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/5db8d64fab0e45ffbba87b1ae3b48703"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/5db8d64fab0e45ffbba87b1ae3b48703"}]}] Jun 16 19:03:20.601440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-TestShelveInstance-1359640481 Jun 16 19:03:20.601440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: 5db8d64fab0e45ffbba87b1ae3b48703 Jun 16 19:03:20.601440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-TestShelveInstance-1359640481 Jun 16 19:03:20.601440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-TestShelveInstance-1359640481-project Jun 16 19:03:20.601440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:03:20.601440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:03:20.601440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 0569765b6f07473fa07a5376b3677da8 Jun 16 19:03:20.601440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-TestShelveInstance-1359640481-project Jun 16 19:03:20.601440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:03:20.601440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance 5bf1ba63-bf52-412b-9948-409dadbbdf18 could not be found. Jun 16 19:03:20.601440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': '5bf1ba63-bf52-412b-9948-409dadbbdf18'} Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf1ba63-bf52-412b-9948-409dadbbdf18 could not be found. Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:20.602389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf1ba63-bf52-412b-9948-409dadbbdf18 could not be found. Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf1ba63-bf52-412b-9948-409dadbbdf18 could not be found. Jun 16 19:03:20.603684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:20.605551 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-bf6b14d2-6815-4bf8-8849-9f5b3596f434 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Returning 404 to user: Instance 5bf1ba63-bf52-412b-9948-409dadbbdf18 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:20.605551 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-bf6b14d2-6815-4bf8-8849-9f5b3596f434 tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18" status: 404 len: 111 microversion: 2.1 time: 0.031286 Jun 16 19:03:20.605551 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 483/931] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:20 2022] GET /compute/v2.1/servers/5bf1ba63-bf52-412b-9948-409dadbbdf18 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:03:20.848424 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3b679b16-9942-4bb8-80aa-ead83cdd11bc tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] Calling method '.version_select at 0x7f2007fcae50>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:20.964463 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3b679b16-9942-4bb8-80aa-ead83cdd11bc tempest-TestShelveInstance-1359640481 tempest-TestShelveInstance-1359640481-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-653739164" status: 202 len: 0 microversion: 2.1 time: 0.120058 Jun 16 19:03:20.965060 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 449/932] 10.222.0.81 () {58 vars in 1250 bytes} [Thu Jun 16 19:03:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-653739164 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:03:48.464921 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c90421ed-0fb6-44b0-9679-e0d421b8bfc9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:48.466216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c90421ed-0fb6-44b0-9679-e0d421b8bfc9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:48.469297 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=19 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:48.470712 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=75 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:48.476031 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c90421ed-0fb6-44b0-9679-e0d421b8bfc9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:48.480813 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c90421ed-0fb6-44b0-9679-e0d421b8bfc9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:48.480813 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c90421ed-0fb6-44b0-9679-e0d421b8bfc9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:48.480813 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c90421ed-0fb6-44b0-9679-e0d421b8bfc9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:48.516326 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c90421ed-0fb6-44b0-9679-e0d421b8bfc9 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056525 Jun 16 19:03:48.516871 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 484/933] 10.222.0.81 () {60 vars in 1342 bytes} [Thu Jun 16 19:03:48 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:48.574825 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-76385406-863c-45e0-9bf0-01c08444d1bb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:48.575478 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-76385406-863c-45e0-9bf0-01c08444d1bb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:48.577841 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:48.578501 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:48.583921 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-76385406-863c-45e0-9bf0-01c08444d1bb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:48.584377 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-76385406-863c-45e0-9bf0-01c08444d1bb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:48.585156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-76385406-863c-45e0-9bf0-01c08444d1bb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:48.586971 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-76385406-863c-45e0-9bf0-01c08444d1bb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:48.612675 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-76385406-863c-45e0-9bf0-01c08444d1bb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Going to try to terminate instance {{(pid=130230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:03:48.872596 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-76385406-863c-45e0-9bf0-01c08444d1bb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "DELETE /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 204 len: 0 microversion: 2.20 time: 0.301582 Jun 16 19:03:48.873178 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 450/934] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jun 16 19:03:48 2022] DELETE /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 19:03:48.882132 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a6dc232c-b3ac-496d-b630-610abb2ae32d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:48.882678 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a6dc232c-b3ac-496d-b630-610abb2ae32d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:48.889555 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a6dc232c-b3ac-496d-b630-610abb2ae32d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:48.890008 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a6dc232c-b3ac-496d-b630-610abb2ae32d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:48.890827 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a6dc232c-b3ac-496d-b630-610abb2ae32d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:48.891269 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a6dc232c-b3ac-496d-b630-610abb2ae32d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:49.027067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a6dc232c-b3ac-496d-b630-610abb2ae32d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:49.036706 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a6dc232c-b3ac-496d-b630-610abb2ae32d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:49.038212 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a6dc232c-b3ac-496d-b630-610abb2ae32d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:49.039364 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a6dc232c-b3ac-496d-b630-610abb2ae32d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.161991 Jun 16 19:03:49.039913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 485/935] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:48 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:49.466267 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1365222992", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452"}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:49.518735 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.network.neutron [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] validate_networks() for None {{(pid=130230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:03:50.035438 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Flavor limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:03:50.036048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Image limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:03:50.036934 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Flavor pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:03:50.037436 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Image pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:03:50.037883 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:03:50.047169 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:50.047774 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:50.048657 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:50.049201 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:50.058934 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-17ec28d9-b287-4ef0-8f67-54c74148ff3d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:50.059726 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-17ec28d9-b287-4ef0-8f67-54c74148ff3d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:50.066746 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-17ec28d9-b287-4ef0-8f67-54c74148ff3d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:50.067900 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-17ec28d9-b287-4ef0-8f67-54c74148ff3d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:50.068502 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Getting quotas for project f450f6cb6a174dc0ad93134e93fe75cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:03:50.068846 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-17ec28d9-b287-4ef0-8f67-54c74148ff3d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:50.069323 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-17ec28d9-b287-4ef0-8f67-54c74148ff3d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:50.072580 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Getting quotas for user d5f31565982b4928abc3bb5df8fbaf5b and project f450f6cb6a174dc0ad93134e93fe75cc. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:03:50.089159 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Going to run 1 instances... {{(pid=130230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:03:50.091551 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:03:50.211255 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-17ec28d9-b287-4ef0-8f67-54c74148ff3d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:50.219329 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-17ec28d9-b287-4ef0-8f67-54c74148ff3d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:50.220843 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-17ec28d9-b287-4ef0-8f67-54c74148ff3d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:50.222235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-17ec28d9-b287-4ef0-8f67-54c74148ff3d tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1721 microversion: 2.20 time: 0.167776 Jun 16 19:03:50.222826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 486/936] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:50 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:03:50.251817 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-87a7024c-030e-47a5-b5e9-7ba1318aea4a tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789690 Jun 16 19:03:50.252458 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 451/937] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 19:03:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:03:50.263001 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-dd4eaecf-977a-4535-8417-d54f1b0039c5 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:50.263615 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-dd4eaecf-977a-4535-8417-d54f1b0039c5 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:50.336726 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-dd4eaecf-977a-4535-8417-d54f1b0039c5 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:50.357098 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-dd4eaecf-977a-4535-8417-d54f1b0039c5 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1215 microversion: 2.1 time: 0.098052 Jun 16 19:03:50.363062 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 487/938] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:50 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:51.217830 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-627c04b8-c9b1-4b0e-aa6e-d7150eea7981 req-0351feb6-6c35-488d-a81f-0c38992710a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33ad0030-d602-4eda-932c-e5a9ff1a7339", "name": "network-vif-deleted", "tag": "876dcbc0-6957-426a-86fc-525cbbd501e9"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:51.227445 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-627c04b8-c9b1-4b0e-aa6e-d7150eea7981 req-0351feb6-6c35-488d-a81f-0c38992710a8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:51.229681 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-627c04b8-c9b1-4b0e-aa6e-d7150eea7981 req-0351feb6-6c35-488d-a81f-0c38992710a8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:51.241908 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ea4d72b5-4373-44b6-9ee8-e3c900f1fd5e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:51.243088 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ea4d72b5-4373-44b6-9ee8-e3c900f1fd5e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:51.244751 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-627c04b8-c9b1-4b0e-aa6e-d7150eea7981 req-0351feb6-6c35-488d-a81f-0c38992710a8 service nova] Creating event network-vif-deleted:876dcbc0-6957-426a-86fc-525cbbd501e9 for instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 on hv-cinder-84617 Jun 16 19:03:51.258038 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-627c04b8-c9b1-4b0e-aa6e-d7150eea7981 req-0351feb6-6c35-488d-a81f-0c38992710a8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044359 Jun 16 19:03:51.262488 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 452/939] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:03:51.382846 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-cf25ea73-6d55-4098-9389-2c4d0e9a0f6f tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:51.386205 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-cf25ea73-6d55-4098-9389-2c4d0e9a0f6f tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:51.404791 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cf25ea73-6d55-4098-9389-2c4d0e9a0f6f tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:51.406434 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cf25ea73-6d55-4098-9389-2c4d0e9a0f6f tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:51.409788 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cf25ea73-6d55-4098-9389-2c4d0e9a0f6f tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:51.410477 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cf25ea73-6d55-4098-9389-2c4d0e9a0f6f tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:51.439989 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ea4d72b5-4373-44b6-9ee8-e3c900f1fd5e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:51.440701 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ea4d72b5-4373-44b6-9ee8-e3c900f1fd5e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:51.442645 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ea4d72b5-4373-44b6-9ee8-e3c900f1fd5e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:51.443092 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ea4d72b5-4373-44b6-9ee8-e3c900f1fd5e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:51.518671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ea4d72b5-4373-44b6-9ee8-e3c900f1fd5e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:51.530280 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ea4d72b5-4373-44b6-9ee8-e3c900f1fd5e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:51.531884 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ea4d72b5-4373-44b6-9ee8-e3c900f1fd5e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2de523abbc7b4f8b972dc97b8a013237', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b607bd5abec4c72842e250a639f99f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:51.541417 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ea4d72b5-4373-44b6-9ee8-e3c900f1fd5e tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 200 len: 1366 microversion: 2.20 time: 0.296182 Jun 16 19:03:51.547343 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-cf25ea73-6d55-4098-9389-2c4d0e9a0f6f tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:51.549882 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 488/940] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:51 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:03:51.555865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-cf25ea73-6d55-4098-9389-2c4d0e9a0f6f tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1219 microversion: 2.1 time: 0.185367 Jun 16 19:03:51.557400 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 453/941] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:51 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1219 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:52.560133 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5ae04a70-b329-4f5e-8a36-e10ffce88b18 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:52.560646 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5ae04a70-b329-4f5e-8a36-e10ffce88b18 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:52.567129 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5ae04a70-b329-4f5e-8a36-e10ffce88b18 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:52.567570 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5ae04a70-b329-4f5e-8a36-e10ffce88b18 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:52.568334 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5ae04a70-b329-4f5e-8a36-e10ffce88b18 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:52.568770 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5ae04a70-b329-4f5e-8a36-e10ffce88b18 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:52.571884 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1c13b496-f46a-4738-a875-1b7ffb641aa5 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:52.573332 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1c13b496-f46a-4738-a875-1b7ffb641aa5 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:52.579771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1c13b496-f46a-4738-a875-1b7ffb641aa5 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:52.580227 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1c13b496-f46a-4738-a875-1b7ffb641aa5 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:52.581081 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1c13b496-f46a-4738-a875-1b7ffb641aa5 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:52.581567 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1c13b496-f46a-4738-a875-1b7ffb641aa5 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:52.584167 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-5ae04a70-b329-4f5e-8a36-e10ffce88b18 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] HTTP exception thrown: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5ae04a70-b329-4f5e-8a36-e10ffce88b18 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Request method failure captured: Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 HTTP/1.1 Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq3zIXyAfD-_lX-hPxhg7kDf8KKithsOiwcaAiJwKp0Qmi1eC1jCugHhhBfE9YTSmOOh1ZOnMbHZU8rf5GbI5pVverm6er7RcXvkhmsP5a5pISO8yyi918gH8PoEDpzquByJ0Ze7_SesrJcCotcCMhRdP8qtjU8DN3n--gVkTg5P8wGY Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: 0b607bd5abec4c72842e250a639f99f1 Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:03:52.585973 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:03:52.587409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b607bd5abec4c72842e250a639f99f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0b607bd5abec4c72842e250a639f99f1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b607bd5abec4c72842e250a639f99f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0b607bd5abec4c72842e250a639f99f1"}]}] Jun 16 19:03:52.587409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:03:52.587409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: 0b607bd5abec4c72842e250a639f99f1 Jun 16 19:03:52.587409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:03:52.587409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-AttachVolumeShelveTestJSON-1091211271-project Jun 16 19:03:52.587409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:03:52.587409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:03:52.587409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 2de523abbc7b4f8b972dc97b8a013237 Jun 16 19:03:52.587409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1091211271-project Jun 16 19:03:52.587409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:03:52.587409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. Jun 16 19:03:52.587409 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': '33ad0030-d602-4eda-932c-e5a9ff1a7339'} Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:52.588318 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. Jun 16 19:03:52.589689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:52.592002 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5ae04a70-b329-4f5e-8a36-e10ffce88b18 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Returning 404 to user: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:52.592002 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5ae04a70-b329-4f5e-8a36-e10ffce88b18 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 404 len: 111 microversion: 2.20 time: 0.032733 Jun 16 19:03:52.592002 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 489/942] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:52 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:03:52.597769 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-75263838-ffdc-40b2-afa4-8e4c85e094b3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '.version_select at 0x7f20187bb5e0>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:52.688583 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1c13b496-f46a-4738-a875-1b7ffb641aa5 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:52.697884 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1c13b496-f46a-4738-a875-1b7ffb641aa5 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1275 microversion: 2.1 time: 0.129915 Jun 16 19:03:52.698794 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 454/943] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:52 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1275 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:52.724646 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-75263838-ffdc-40b2-afa4-8e4c85e094b3 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354684831" status: 204 len: 0 microversion: 2.20 time: 0.126382 Jun 16 19:03:52.724646 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 490/944] 10.222.0.81 () {60 vars in 1261 bytes} [Thu Jun 16 19:03:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1354684831 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 19:03:53.721748 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e618f3a4-ce99-46a5-9345-a38114d61004 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:53.723060 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e618f3a4-ce99-46a5-9345-a38114d61004 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:53.731207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e618f3a4-ce99-46a5-9345-a38114d61004 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:53.731683 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e618f3a4-ce99-46a5-9345-a38114d61004 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:53.732476 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e618f3a4-ce99-46a5-9345-a38114d61004 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:53.732916 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e618f3a4-ce99-46a5-9345-a38114d61004 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:53.918395 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e618f3a4-ce99-46a5-9345-a38114d61004 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:53.926544 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e618f3a4-ce99-46a5-9345-a38114d61004 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1315 microversion: 2.1 time: 0.214243 Jun 16 19:03:53.927123 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 455/945] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:53 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:54.782566 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-c1c26b04-21b2-462a-a8d4-a27e9c791b0f req-48237964-7a87-45f9-bed5-d7c6c5d4462a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e609d628-b50e-4cc7-af5b-282585a90654", "tag": "c5907eca-11a1-4505-9452-c9f25bec99e8"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:54.794719 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-c1c26b04-21b2-462a-a8d4-a27e9c791b0f req-48237964-7a87-45f9-bed5-d7c6c5d4462a service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:54.795456 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-c1c26b04-21b2-462a-a8d4-a27e9c791b0f req-48237964-7a87-45f9-bed5-d7c6c5d4462a service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:54.808040 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-c1c26b04-21b2-462a-a8d4-a27e9c791b0f req-48237964-7a87-45f9-bed5-d7c6c5d4462a service nova] Creating event network-changed:c5907eca-11a1-4505-9452-c9f25bec99e8 for instance e609d628-b50e-4cc7-af5b-282585a90654 on hv-cinder-84617 Jun 16 19:03:54.813790 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-c1c26b04-21b2-462a-a8d4-a27e9c791b0f req-48237964-7a87-45f9-bed5-d7c6c5d4462a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036476 Jun 16 19:03:54.814394 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 491/946] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:03:54.905945 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4bc2e565-aefe-4d5a-bf12-4764af3aefe0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:54.907163 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4bc2e565-aefe-4d5a-bf12-4764af3aefe0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:54.915019 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4bc2e565-aefe-4d5a-bf12-4764af3aefe0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:54.915688 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4bc2e565-aefe-4d5a-bf12-4764af3aefe0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:54.916755 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4bc2e565-aefe-4d5a-bf12-4764af3aefe0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:54.917409 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4bc2e565-aefe-4d5a-bf12-4764af3aefe0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:54.935298 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-4bc2e565-aefe-4d5a-bf12-4764af3aefe0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] HTTP exception thrown: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4bc2e565-aefe-4d5a-bf12-4764af3aefe0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Request method failure captured: Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: DELETE /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 HTTP/1.1 Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq3zIXyAfD-_lX-hPxhg7kDf8KKithsOiwcaAiJwKp0Qmi1eC1jCugHhhBfE9YTSmOOh1ZOnMbHZU8rf5GbI5pVverm6er7RcXvkhmsP5a5pISO8yyi918gH8PoEDpzquByJ0Ze7_SesrJcCotcCMhRdP8qtjU8DN3n--gVkTg5P8wGY Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: 0b607bd5abec4c72842e250a639f99f1 Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:03:54.937317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:03:54.938974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b607bd5abec4c72842e250a639f99f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0b607bd5abec4c72842e250a639f99f1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b607bd5abec4c72842e250a639f99f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0b607bd5abec4c72842e250a639f99f1"}]}] Jun 16 19:03:54.938974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:03:54.938974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: 0b607bd5abec4c72842e250a639f99f1 Jun 16 19:03:54.938974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:03:54.938974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-AttachVolumeShelveTestJSON-1091211271-project Jun 16 19:03:54.938974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:03:54.938974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:03:54.938974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 2de523abbc7b4f8b972dc97b8a013237 Jun 16 19:03:54.938974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1091211271-project Jun 16 19:03:54.938974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:03:54.938974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. Jun 16 19:03:54.938974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': '33ad0030-d602-4eda-932c-e5a9ff1a7339'} Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:54.939725 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. Jun 16 19:03:54.940951 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:54.948888 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-fe28308a-454d-4fa4-8309-6952ed7cadb6 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:54.950039 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-fe28308a-454d-4fa4-8309-6952ed7cadb6 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:54.954732 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4bc2e565-aefe-4d5a-bf12-4764af3aefe0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Returning 404 to user: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:54.957351 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4bc2e565-aefe-4d5a-bf12-4764af3aefe0 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "DELETE /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 404 len: 111 microversion: 2.20 time: 0.056161 Jun 16 19:03:54.959813 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 456/947] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jun 16 19:03:54 2022] DELETE /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:03:54.960321 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fe28308a-454d-4fa4-8309-6952ed7cadb6 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:54.961018 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fe28308a-454d-4fa4-8309-6952ed7cadb6 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:54.963084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fe28308a-454d-4fa4-8309-6952ed7cadb6 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:54.964014 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fe28308a-454d-4fa4-8309-6952ed7cadb6 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:54.975359 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e2cde578-633b-456c-bffc-087c0ef0c0af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:54.979296 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e2cde578-633b-456c-bffc-087c0ef0c0af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: 33ad0030-d602-4eda-932c-e5a9ff1a7339] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:54.993750 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e2cde578-633b-456c-bffc-087c0ef0c0af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:54.995128 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e2cde578-633b-456c-bffc-087c0ef0c0af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:54.996118 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e2cde578-633b-456c-bffc-087c0ef0c0af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:54.996806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e2cde578-633b-456c-bffc-087c0ef0c0af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:55.016591 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-e2cde578-633b-456c-bffc-087c0ef0c0af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] HTTP exception thrown: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e2cde578-633b-456c-bffc-087c0ef0c0af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Request method failure captured: Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 HTTP/1.1 Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq3zIXyAfD-_lX-hPxhg7kDf8KKithsOiwcaAiJwKp0Qmi1eC1jCugHhhBfE9YTSmOOh1ZOnMbHZU8rf5GbI5pVverm6er7RcXvkhmsP5a5pISO8yyi918gH8PoEDpzquByJ0Ze7_SesrJcCotcCMhRdP8qtjU8DN3n--gVkTg5P8wGY Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: 0b607bd5abec4c72842e250a639f99f1 Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:03:55.018468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:03:55.020816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b607bd5abec4c72842e250a639f99f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0b607bd5abec4c72842e250a639f99f1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b607bd5abec4c72842e250a639f99f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0b607bd5abec4c72842e250a639f99f1"}]}] Jun 16 19:03:55.020816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:03:55.020816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: 0b607bd5abec4c72842e250a639f99f1 Jun 16 19:03:55.020816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:03:55.020816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-AttachVolumeShelveTestJSON-1091211271-project Jun 16 19:03:55.020816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:03:55.020816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:03:55.020816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 2de523abbc7b4f8b972dc97b8a013237 Jun 16 19:03:55.020816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1091211271-project Jun 16 19:03:55.020816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:03:55.020816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. Jun 16 19:03:55.020816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': '33ad0030-d602-4eda-932c-e5a9ff1a7339'} Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:55.021601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. Jun 16 19:03:55.022806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:55.025419 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e2cde578-633b-456c-bffc-087c0ef0c0af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Returning 404 to user: Instance 33ad0030-d602-4eda-932c-e5a9ff1a7339 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:55.026444 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e2cde578-633b-456c-bffc-087c0ef0c0af tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339" status: 404 len: 111 microversion: 2.20 time: 0.063191 Jun 16 19:03:55.027092 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 457/948] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:54 2022] GET /compute/v2.1/servers/33ad0030-d602-4eda-932c-e5a9ff1a7339 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:03:55.176958 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-fe28308a-454d-4fa4-8309-6952ed7cadb6 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:55.184889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-fe28308a-454d-4fa4-8309-6952ed7cadb6 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1315 microversion: 2.1 time: 0.240237 Jun 16 19:03:55.185470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 492/949] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:54 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:56.202141 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e2ab4077-7865-47e7-a411-df8f2a827abf tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:56.202756 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e2ab4077-7865-47e7-a411-df8f2a827abf tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:56.213299 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e2ab4077-7865-47e7-a411-df8f2a827abf tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:56.213299 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e2ab4077-7865-47e7-a411-df8f2a827abf tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:56.213299 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e2ab4077-7865-47e7-a411-df8f2a827abf tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:56.213299 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e2ab4077-7865-47e7-a411-df8f2a827abf tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:56.342899 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e2ab4077-7865-47e7-a411-df8f2a827abf tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:56.351411 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e2ab4077-7865-47e7-a411-df8f2a827abf tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1315 microversion: 2.1 time: 0.153210 Jun 16 19:03:56.352247 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 458/950] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:56 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:56.362025 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6b7e59e5-7b47-4af6-afa6-f7c875c788eb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:56.362551 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6b7e59e5-7b47-4af6-afa6-f7c875c788eb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:56.369291 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6b7e59e5-7b47-4af6-afa6-f7c875c788eb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:56.369725 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6b7e59e5-7b47-4af6-afa6-f7c875c788eb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:56.370515 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6b7e59e5-7b47-4af6-afa6-f7c875c788eb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:56.370945 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6b7e59e5-7b47-4af6-afa6-f7c875c788eb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:56.384954 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-6b7e59e5-7b47-4af6-afa6-f7c875c788eb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] HTTP exception thrown: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6b7e59e5-7b47-4af6-afa6-f7c875c788eb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Request method failure captured: Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: DELETE /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 HTTP/1.1 Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq3zIXyAfD-_lX-hPxhg7kDf8KKithsOiwcaAiJwKp0Qmi1eC1jCugHhhBfE9YTSmOOh1ZOnMbHZU8rf5GbI5pVverm6er7RcXvkhmsP5a5pISO8yyi918gH8PoEDpzquByJ0Ze7_SesrJcCotcCMhRdP8qtjU8DN3n--gVkTg5P8wGY Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: 0b607bd5abec4c72842e250a639f99f1 Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:03:56.386639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:03:56.388327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b607bd5abec4c72842e250a639f99f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0b607bd5abec4c72842e250a639f99f1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b607bd5abec4c72842e250a639f99f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0b607bd5abec4c72842e250a639f99f1"}]}] Jun 16 19:03:56.388327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:03:56.388327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: 0b607bd5abec4c72842e250a639f99f1 Jun 16 19:03:56.388327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:03:56.388327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-AttachVolumeShelveTestJSON-1091211271-project Jun 16 19:03:56.388327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:03:56.388327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:03:56.388327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 2de523abbc7b4f8b972dc97b8a013237 Jun 16 19:03:56.388327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1091211271-project Jun 16 19:03:56.388327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:03:56.388327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. Jun 16 19:03:56.388327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': 'd6c04798-b061-421b-9b61-db9cce7dace4'} Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:56.389158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. Jun 16 19:03:56.391384 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:03:56.392869 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6b7e59e5-7b47-4af6-afa6-f7c875c788eb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Returning 404 to user: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:56.392869 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6b7e59e5-7b47-4af6-afa6-f7c875c788eb tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 404 len: 111 microversion: 2.20 time: 0.029854 Jun 16 19:03:56.392869 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 493/951] 10.222.0.81 () {60 vars in 1279 bytes} [Thu Jun 16 19:03:56 2022] DELETE /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:03:56.397147 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-91a9c4be-d6cc-48b2-8e3a-6ff680ccea12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:56.397780 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-91a9c4be-d6cc-48b2-8e3a-6ff680ccea12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] [instance: d6c04798-b061-421b-9b61-db9cce7dace4] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:56.403641 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-91a9c4be-d6cc-48b2-8e3a-6ff680ccea12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:56.404084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-91a9c4be-d6cc-48b2-8e3a-6ff680ccea12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:56.404846 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-91a9c4be-d6cc-48b2-8e3a-6ff680ccea12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:56.405304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-91a9c4be-d6cc-48b2-8e3a-6ff680ccea12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:56.418146 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-91a9c4be-d6cc-48b2-8e3a-6ff680ccea12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] HTTP exception thrown: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-91a9c4be-d6cc-48b2-8e3a-6ff680ccea12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Request method failure captured: Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 HTTP/1.1 Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq3zIXyAfD-_lX-hPxhg7kDf8KKithsOiwcaAiJwKp0Qmi1eC1jCugHhhBfE9YTSmOOh1ZOnMbHZU8rf5GbI5pVverm6er7RcXvkhmsP5a5pISO8yyi918gH8PoEDpzquByJ0Ze7_SesrJcCotcCMhRdP8qtjU8DN3n--gVkTg5P8wGY Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: 0b607bd5abec4c72842e250a639f99f1 Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:03:56.419647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:03:56.421328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b607bd5abec4c72842e250a639f99f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_0b607bd5abec4c72842e250a639f99f1", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/0b607bd5abec4c72842e250a639f99f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/0b607bd5abec4c72842e250a639f99f1"}]}] Jun 16 19:03:56.421328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:03:56.421328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: 0b607bd5abec4c72842e250a639f99f1 Jun 16 19:03:56.421328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1091211271 Jun 16 19:03:56.421328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-AttachVolumeShelveTestJSON-1091211271-project Jun 16 19:03:56.421328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:03:56.421328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:03:56.421328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 2de523abbc7b4f8b972dc97b8a013237 Jun 16 19:03:56.421328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1091211271-project Jun 16 19:03:56.421328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:03:56.421328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. Jun 16 19:03:56.421328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': 'd6c04798-b061-421b-9b61-db9cce7dace4'} Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:56.422381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. Jun 16 19:03:56.423866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:03:56.425664 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-91a9c4be-d6cc-48b2-8e3a-6ff680ccea12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] Returning 404 to user: Instance d6c04798-b061-421b-9b61-db9cce7dace4 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:56.425664 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-91a9c4be-d6cc-48b2-8e3a-6ff680ccea12 tempest-AttachVolumeShelveTestJSON-1091211271 tempest-AttachVolumeShelveTestJSON-1091211271-project] 10.222.0.81 "GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4" status: 404 len: 111 microversion: 2.20 time: 0.028311 Jun 16 19:03:56.425664 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 459/952] 10.222.0.81 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:56 2022] GET /compute/v2.1/servers/d6c04798-b061-421b-9b61-db9cce7dace4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 19:03:57.368186 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ab87cd80-233b-478c-9059-7805c2b892e1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:57.368958 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ab87cd80-233b-478c-9059-7805c2b892e1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:57.377810 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ab87cd80-233b-478c-9059-7805c2b892e1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:57.377810 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ab87cd80-233b-478c-9059-7805c2b892e1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:57.377810 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ab87cd80-233b-478c-9059-7805c2b892e1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:57.377810 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ab87cd80-233b-478c-9059-7805c2b892e1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:57.837599 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-ab87cd80-233b-478c-9059-7805c2b892e1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:57.849305 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ab87cd80-233b-478c-9059-7805c2b892e1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1315 microversion: 2.1 time: 0.484473 Jun 16 19:03:57.850698 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 494/953] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:57 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:58.866676 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-86559b4f-fdd3-48e8-b389-22ce6c4f0972 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:58.867328 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-86559b4f-fdd3-48e8-b389-22ce6c4f0972 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:58.873908 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-86559b4f-fdd3-48e8-b389-22ce6c4f0972 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:58.874362 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-86559b4f-fdd3-48e8-b389-22ce6c4f0972 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:58.875143 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-86559b4f-fdd3-48e8-b389-22ce6c4f0972 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:58.875584 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-86559b4f-fdd3-48e8-b389-22ce6c4f0972 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:59.079449 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-86559b4f-fdd3-48e8-b389-22ce6c4f0972 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:59.092234 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-86559b4f-fdd3-48e8-b389-22ce6c4f0972 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1315 microversion: 2.1 time: 0.228507 Jun 16 19:03:59.093030 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 460/954] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:58 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:00.110341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-eb8f891f-382b-4c61-8852-8187e9e38227 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:00.111099 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-eb8f891f-382b-4c61-8852-8187e9e38227 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:00.117861 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-eb8f891f-382b-4c61-8852-8187e9e38227 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:00.118309 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-eb8f891f-382b-4c61-8852-8187e9e38227 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:00.119092 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-eb8f891f-382b-4c61-8852-8187e9e38227 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:00.119530 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-eb8f891f-382b-4c61-8852-8187e9e38227 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:00.291061 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-eb8f891f-382b-4c61-8852-8187e9e38227 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:00.299192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-eb8f891f-382b-4c61-8852-8187e9e38227 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1315 microversion: 2.1 time: 0.192845 Jun 16 19:04:00.299761 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 495/955] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:00 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:01.316309 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-84e44c44-8f5b-42bc-981f-18e55b9c5660 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:01.317088 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-84e44c44-8f5b-42bc-981f-18e55b9c5660 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:01.319696 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:01.320460 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=6 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:01.325516 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-84e44c44-8f5b-42bc-981f-18e55b9c5660 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:01.326212 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-84e44c44-8f5b-42bc-981f-18e55b9c5660 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:01.327062 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-84e44c44-8f5b-42bc-981f-18e55b9c5660 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:01.327577 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-84e44c44-8f5b-42bc-981f-18e55b9c5660 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:01.465532 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-84e44c44-8f5b-42bc-981f-18e55b9c5660 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:01.475427 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-84e44c44-8f5b-42bc-981f-18e55b9c5660 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1315 microversion: 2.1 time: 0.163217 Jun 16 19:04:01.476013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 461/956] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:01 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:02.491839 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e3a61a26-0ea5-4edc-be22-a44e1116a796 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:02.492462 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e3a61a26-0ea5-4edc-be22-a44e1116a796 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:02.497439 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:02.506151 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e3a61a26-0ea5-4edc-be22-a44e1116a796 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:02.506865 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e3a61a26-0ea5-4edc-be22-a44e1116a796 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:02.507650 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e3a61a26-0ea5-4edc-be22-a44e1116a796 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:02.508270 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e3a61a26-0ea5-4edc-be22-a44e1116a796 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:02.653831 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e3a61a26-0ea5-4edc-be22-a44e1116a796 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:02.661357 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e3a61a26-0ea5-4edc-be22-a44e1116a796 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1315 microversion: 2.1 time: 0.173387 Jun 16 19:04:02.661917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 496/957] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:02 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:03.679838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-445d4ae9-094c-4eea-98eb-5ee11b19a67e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:03.680485 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-445d4ae9-094c-4eea-98eb-5ee11b19a67e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:03.687632 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-445d4ae9-094c-4eea-98eb-5ee11b19a67e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:03.688080 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-445d4ae9-094c-4eea-98eb-5ee11b19a67e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:03.688893 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-445d4ae9-094c-4eea-98eb-5ee11b19a67e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:03.689558 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-445d4ae9-094c-4eea-98eb-5ee11b19a67e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:03.837967 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-445d4ae9-094c-4eea-98eb-5ee11b19a67e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:03.852583 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-445d4ae9-094c-4eea-98eb-5ee11b19a67e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1315 microversion: 2.1 time: 0.177722 Jun 16 19:04:03.856748 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 462/958] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:03 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:04.377746 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-5bbf3103-d5e3-47d2-a0d1-77d9d0dbf347 req-3c839c2e-e6bf-4ea8-ace6-686b62015ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e609d628-b50e-4cc7-af5b-282585a90654", "name": "network-vif-plugged", "status": "completed", "tag": "c5907eca-11a1-4505-9452-c9f25bec99e8"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:04.388976 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-5bbf3103-d5e3-47d2-a0d1-77d9d0dbf347 req-3c839c2e-e6bf-4ea8-ace6-686b62015ec8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:04.389562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-5bbf3103-d5e3-47d2-a0d1-77d9d0dbf347 req-3c839c2e-e6bf-4ea8-ace6-686b62015ec8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:04.401420 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-5bbf3103-d5e3-47d2-a0d1-77d9d0dbf347 req-3c839c2e-e6bf-4ea8-ace6-686b62015ec8 service nova] Creating event network-vif-plugged:c5907eca-11a1-4505-9452-c9f25bec99e8 for instance e609d628-b50e-4cc7-af5b-282585a90654 on hv-cinder-84617 Jun 16 19:04:04.406928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-5bbf3103-d5e3-47d2-a0d1-77d9d0dbf347 req-3c839c2e-e6bf-4ea8-ace6-686b62015ec8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032989 Jun 16 19:04:04.407550 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 497/959] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:04.870747 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9e83c42d-5506-4190-a949-2dc8a7eddfa9 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:04.871385 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9e83c42d-5506-4190-a949-2dc8a7eddfa9 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:04.879856 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9e83c42d-5506-4190-a949-2dc8a7eddfa9 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:04.880342 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9e83c42d-5506-4190-a949-2dc8a7eddfa9 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:04.886180 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9e83c42d-5506-4190-a949-2dc8a7eddfa9 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:04.886180 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9e83c42d-5506-4190-a949-2dc8a7eddfa9 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:05.038409 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9e83c42d-5506-4190-a949-2dc8a7eddfa9 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:05.045935 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9e83c42d-5506-4190-a949-2dc8a7eddfa9 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1315 microversion: 2.1 time: 0.179115 Jun 16 19:04:05.046552 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 463/960] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:04 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:06.065603 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-252b5950-1536-4a23-ad06-fe2808d6331e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:06.066880 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-252b5950-1536-4a23-ad06-fe2808d6331e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:06.074764 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-252b5950-1536-4a23-ad06-fe2808d6331e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:06.075214 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-252b5950-1536-4a23-ad06-fe2808d6331e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:06.075991 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-252b5950-1536-4a23-ad06-fe2808d6331e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:06.076433 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-252b5950-1536-4a23-ad06-fe2808d6331e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:06.257866 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-252b5950-1536-4a23-ad06-fe2808d6331e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:06.269750 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-252b5950-1536-4a23-ad06-fe2808d6331e tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1315 microversion: 2.1 time: 0.207932 Jun 16 19:04:06.282609 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 498/961] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:06 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:06.834197 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-35530093", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1310473773", "security_groups": [{"name": "tempest-secgroup-smoke-1909774442"}], "block_device_mapping_v2": [{"uuid": "4f1d7201-2cfa-4ccc-a8c0-7c88856f9a90", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f31f33e6-f431-4d4c-a847-a5f33b248bb8"}]}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:06.977629 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.network.neutron [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] validate_networks() for [('f31f33e6-f431-4d4c-a847-a5f33b248bb8', None, None, None, None, None)] {{(pid=130230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:04:07.289970 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b1e47acb-f412-4efa-8e63-10805758d3f0 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:07.289970 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b1e47acb-f412-4efa-8e63-10805758d3f0 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:07.299028 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b1e47acb-f412-4efa-8e63-10805758d3f0 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:07.301711 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b1e47acb-f412-4efa-8e63-10805758d3f0 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:07.303231 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b1e47acb-f412-4efa-8e63-10805758d3f0 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:07.303667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b1e47acb-f412-4efa-8e63-10805758d3f0 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:07.545497 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b1e47acb-f412-4efa-8e63-10805758d3f0 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:07.549435 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Flavor limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:04:07.549886 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Image limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:04:07.550353 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Flavor pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:04:07.554045 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Image pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:04:07.554465 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:04:07.563720 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b1e47acb-f412-4efa-8e63-10805758d3f0 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1465 microversion: 2.1 time: 0.279642 Jun 16 19:04:07.564617 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 499/962] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:07 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1465 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:07.570648 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:07.571371 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:07.572364 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:07.572994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:07.596477 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Getting quotas for project fc32e3179c534d83b3d4108a38fb9d19. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:04:07.601892 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Getting quotas for user 1c0e7e9f9d0f409a8820d8bd8dd239cf and project fc32e3179c534d83b3d4108a38fb9d19. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:04:07.607236 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-dc0b775d-7af3-4139-8568-ba9c1110771b tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:07.608272 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-dc0b775d-7af3-4139-8568-ba9c1110771b tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:07.616436 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dc0b775d-7af3-4139-8568-ba9c1110771b tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:07.617180 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dc0b775d-7af3-4139-8568-ba9c1110771b tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:07.618154 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dc0b775d-7af3-4139-8568-ba9c1110771b tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:07.618772 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-dc0b775d-7af3-4139-8568-ba9c1110771b tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:07.651429 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-dc0b775d-7af3-4139-8568-ba9c1110771b tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Going to try to terminate instance {{(pid=130229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:04:07.738798 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Going to run 1 instances... {{(pid=130230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:04:07.741124 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f1d7201-2cfa-4ccc-a8c0-7c88856f9a90',volume_size=None,volume_type=None)] {{(pid=130230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:04:07.994924 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-dc0b775d-7af3-4139-8568-ba9c1110771b tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "DELETE /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 204 len: 0 microversion: 2.1 time: 0.391272 Jun 16 19:04:07.996036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 500/963] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:04:07 2022] DELETE /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:04:08.009580 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3ee938f5-04c2-4d20-869d-d48132fadb4c tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:08.010320 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3ee938f5-04c2-4d20-869d-d48132fadb4c tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:08.020300 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3ee938f5-04c2-4d20-869d-d48132fadb4c tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:08.021920 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3ee938f5-04c2-4d20-869d-d48132fadb4c tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:08.022936 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3ee938f5-04c2-4d20-869d-d48132fadb4c tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:08.023971 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3ee938f5-04c2-4d20-869d-d48132fadb4c tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:08.314028 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3ee938f5-04c2-4d20-869d-d48132fadb4c tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:08.322941 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3ee938f5-04c2-4d20-869d-d48132fadb4c tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1471 microversion: 2.1 time: 0.321274 Jun 16 19:04:08.346090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 501/964] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:07 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1471 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:08.357218 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f8643e7e-c815-40e2-b924-04a4cbd7013f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.527374 Jun 16 19:04:08.358839 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 464/965] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 19:04:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:04:08.372470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-66ae97b7-d09d-4f17-ac02-6298932cae40 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:08.373323 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-66ae97b7-d09d-4f17-ac02-6298932cae40 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:08.478744 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-66ae97b7-d09d-4f17-ac02-6298932cae40 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:08.488833 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-66ae97b7-d09d-4f17-ac02-6298932cae40 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1093 microversion: 2.1 time: 0.123871 Jun 16 19:04:08.489788 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 502/966] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:08 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1093 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:08.646495 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f151c010-72f6-4b96-ba13-553bcb2b2710 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Action: 'create', calling method: .version_select at 0x7f2007fca670>, body: {"keypair": {"name": "tempest-keypair-1450587355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdi29A99ixEIOwYnJOCbTfsYnXBl8Ux1mGINZU2aClTN0L//OXTGGCSxLfvEbshJNNZ7Pz8wNUPDXLKOducN2QW81egeJGIQ/fAyAAuB5Uoy0BqTKto6EGYFuELyXu9yw=="}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:08.661690 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-f151c010-72f6-4b96-ba13-553bcb2b2710 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'key_pairs'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:04:08.665857 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-f151c010-72f6-4b96-ba13-553bcb2b2710 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for user 06722257713746f697d1f609c3956e05 and project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'key_pairs'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:04:08.756861 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f151c010-72f6-4b96-ba13-553bcb2b2710 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.286114 Jun 16 19:04:08.757792 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 465/967] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jun 16 19:04:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:09.353925 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e5bbda89-a221-449e-bbc7-67fac3ce9746 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:09.355263 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e5bbda89-a221-449e-bbc7-67fac3ce9746 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:09.365819 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e5bbda89-a221-449e-bbc7-67fac3ce9746 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:09.366455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e5bbda89-a221-449e-bbc7-67fac3ce9746 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:09.367425 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e5bbda89-a221-449e-bbc7-67fac3ce9746 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:09.368024 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e5bbda89-a221-449e-bbc7-67fac3ce9746 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:09.507559 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5895faa0-abfd-4e6d-85e8-77e36a809d13 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:09.508176 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5895faa0-abfd-4e6d-85e8-77e36a809d13 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:09.517943 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5895faa0-abfd-4e6d-85e8-77e36a809d13 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:09.517943 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5895faa0-abfd-4e6d-85e8-77e36a809d13 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:09.517943 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5895faa0-abfd-4e6d-85e8-77e36a809d13 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:09.518214 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5895faa0-abfd-4e6d-85e8-77e36a809d13 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:09.626083 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5895faa0-abfd-4e6d-85e8-77e36a809d13 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:09.627848 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e5bbda89-a221-449e-bbc7-67fac3ce9746 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:09.638717 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e5bbda89-a221-449e-bbc7-67fac3ce9746 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1471 microversion: 2.1 time: 0.289819 Jun 16 19:04:09.641945 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 503/968] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:09 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1471 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:09.643859 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5895faa0-abfd-4e6d-85e8-77e36a809d13 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1143 microversion: 2.1 time: 0.141009 Jun 16 19:04:09.644441 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 466/969] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:09 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1143 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:10.152100 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-da05fe72-fee7-401d-aef5-e653d2744221 req-a5691c22-1e88-4efb-864e-69e23fb507aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e609d628-b50e-4cc7-af5b-282585a90654", "name": "network-vif-deleted", "tag": "c5907eca-11a1-4505-9452-c9f25bec99e8"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:10.162759 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-da05fe72-fee7-401d-aef5-e653d2744221 req-a5691c22-1e88-4efb-864e-69e23fb507aa service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:10.163204 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-da05fe72-fee7-401d-aef5-e653d2744221 req-a5691c22-1e88-4efb-864e-69e23fb507aa service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:10.181966 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-da05fe72-fee7-401d-aef5-e653d2744221 req-a5691c22-1e88-4efb-864e-69e23fb507aa service nova] Creating event network-vif-deleted:c5907eca-11a1-4505-9452-c9f25bec99e8 for instance e609d628-b50e-4cc7-af5b-282585a90654 on hv-cinder-84617 Jun 16 19:04:10.188012 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-da05fe72-fee7-401d-aef5-e653d2744221 req-a5691c22-1e88-4efb-864e-69e23fb507aa service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039628 Jun 16 19:04:10.188917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 504/970] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:10.662640 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-08759784-32b4-452a-abb1-0494ceecb02a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:10.663312 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-08759784-32b4-452a-abb1-0494ceecb02a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:10.664041 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a6e9a76d-4efc-4d2d-bc73-979eab57d9d1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:10.665146 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a6e9a76d-4efc-4d2d-bc73-979eab57d9d1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:10.669604 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08759784-32b4-452a-abb1-0494ceecb02a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:10.686808 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08759784-32b4-452a-abb1-0494ceecb02a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:10.686808 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08759784-32b4-452a-abb1-0494ceecb02a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:10.686808 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-08759784-32b4-452a-abb1-0494ceecb02a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:10.687116 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a6e9a76d-4efc-4d2d-bc73-979eab57d9d1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:10.687116 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a6e9a76d-4efc-4d2d-bc73-979eab57d9d1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:10.687116 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a6e9a76d-4efc-4d2d-bc73-979eab57d9d1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:10.687116 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a6e9a76d-4efc-4d2d-bc73-979eab57d9d1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:10.687434 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:10.716447 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a6e9a76d-4efc-4d2d-bc73-979eab57d9d1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:10.716891 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a6e9a76d-4efc-4d2d-bc73-979eab57d9d1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:10.717391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.objects.instance [None req-a6e9a76d-4efc-4d2d-bc73-979eab57d9d1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lazy-loading 'fault' on Instance uuid e609d628-b50e-4cc7-af5b-282585a90654 {{(pid=130230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:04:10.745125 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-08759784-32b4-452a-abb1-0494ceecb02a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:10.756392 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-08759784-32b4-452a-abb1-0494ceecb02a tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1191 microversion: 2.1 time: 0.098515 Jun 16 19:04:10.757655 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 505/971] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:10 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1191 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:10.788080 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a6e9a76d-4efc-4d2d-bc73-979eab57d9d1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5f31565982b4928abc3bb5df8fbaf5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f450f6cb6a174dc0ad93134e93fe75cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:10.798074 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a6e9a76d-4efc-4d2d-bc73-979eab57d9d1 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 200 len: 1305 microversion: 2.1 time: 0.140052 Jun 16 19:04:10.808771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 467/972] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:10 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 1305 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:11.610362 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-542744752", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f5b1bf4-16e2-474a-b72c-6a89096e68f2"}], "security_groups": [{"name": "tempest-securitygroup--1166610918"}], "key_name": "tempest-keypair-1450587355", "user_data": "}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:11.774943 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ed16ddc5-49e1-4ccf-9a7e-bdbf4c8d9fa1 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:11.776389 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ed16ddc5-49e1-4ccf-9a7e-bdbf4c8d9fa1 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:11.784619 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ed16ddc5-49e1-4ccf-9a7e-bdbf4c8d9fa1 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:11.785068 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ed16ddc5-49e1-4ccf-9a7e-bdbf4c8d9fa1 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:11.785923 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ed16ddc5-49e1-4ccf-9a7e-bdbf4c8d9fa1 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:11.786362 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ed16ddc5-49e1-4ccf-9a7e-bdbf4c8d9fa1 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:12.004653 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ed16ddc5-49e1-4ccf-9a7e-bdbf4c8d9fa1 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:12.019629 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ed16ddc5-49e1-4ccf-9a7e-bdbf4c8d9fa1 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1209 microversion: 2.1 time: 0.249045 Jun 16 19:04:12.020216 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 468/973] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:11 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1209 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:12.025601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2664ab7d-e37c-4290-8565-2ef4240c1c74 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:12.041262 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2664ab7d-e37c-4290-8565-2ef4240c1c74 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] [instance: e609d628-b50e-4cc7-af5b-282585a90654] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:12.048773 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2664ab7d-e37c-4290-8565-2ef4240c1c74 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:12.049225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2664ab7d-e37c-4290-8565-2ef4240c1c74 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:12.050024 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2664ab7d-e37c-4290-8565-2ef4240c1c74 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:12.050475 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2664ab7d-e37c-4290-8565-2ef4240c1c74 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:12.074355 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-2664ab7d-e37c-4290-8565-2ef4240c1c74 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] HTTP exception thrown: Instance e609d628-b50e-4cc7-af5b-282585a90654 could not be found. Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2664ab7d-e37c-4290-8565-2ef4240c1c74 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Request method failure captured: Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 HTTP/1.1 Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq36T2W89ufOg-dHO4WupD7jIyUxF10BaOkakeu30Vc-kCGMc1zAzTu0yxivjBjt3FvlqTlCrmaRibPDZ6AaUbe__I_c1opcEuirMsZcQeZ0lR4I2hc9kwOMPV0typ5ar1RZ6oiH-3mO0_oEYKGyX2O1MJ-ZF3VNGDSQnTaejpgm_snA Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: f450f6cb6a174dc0ad93134e93fe75cc Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-VolumesNegativeTest-1913914902 Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:04:12.076491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:04:12.078061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f450f6cb6a174dc0ad93134e93fe75cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_f450f6cb6a174dc0ad93134e93fe75cc", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/f450f6cb6a174dc0ad93134e93fe75cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/f450f6cb6a174dc0ad93134e93fe75cc"}]}] Jun 16 19:04:12.078061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-VolumesNegativeTest-1913914902 Jun 16 19:04:12.078061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: f450f6cb6a174dc0ad93134e93fe75cc Jun 16 19:04:12.078061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-VolumesNegativeTest-1913914902 Jun 16 19:04:12.078061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-VolumesNegativeTest-1913914902-project Jun 16 19:04:12.078061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:04:12.078061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:04:12.078061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: d5f31565982b4928abc3bb5df8fbaf5b Jun 16 19:04:12.078061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-VolumesNegativeTest-1913914902-project Jun 16 19:04:12.078061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:04:12.078061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance e609d628-b50e-4cc7-af5b-282585a90654 could not be found. Jun 16 19:04:12.078061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': 'e609d628-b50e-4cc7-af5b-282585a90654'} Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e609d628-b50e-4cc7-af5b-282585a90654 could not be found. Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:04:12.078849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e609d628-b50e-4cc7-af5b-282585a90654 could not be found. Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e609d628-b50e-4cc7-af5b-282585a90654 could not be found. Jun 16 19:04:12.081100 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:04:12.084812 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2664ab7d-e37c-4290-8565-2ef4240c1c74 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] Returning 404 to user: Instance e609d628-b50e-4cc7-af5b-282585a90654 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:04:12.085989 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2664ab7d-e37c-4290-8565-2ef4240c1c74 tempest-VolumesNegativeTest-1913914902 tempest-VolumesNegativeTest-1913914902-project] 10.222.0.81 "GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654" status: 404 len: 111 microversion: 2.1 time: 0.064648 Jun 16 19:04:12.092807 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 469/974] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:12 2022] GET /compute/v2.1/servers/e609d628-b50e-4cc7-af5b-282585a90654 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:04:12.117886 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.network.neutron [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] validate_networks() for [('9f5b1bf4-16e2-474a-b72c-6a89096e68f2', None, None, None, None, None)] {{(pid=130229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:04:12.797643 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Flavor limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:04:12.800518 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Image limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:04:12.801964 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Flavor pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:04:12.802495 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Image pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:04:12.803360 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:04:12.818009 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:12.818715 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:12.821387 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:12.821387 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:12.843638 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:04:12.853050 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for user 06722257713746f697d1f609c3956e05 and project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:04:12.870660 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Going to run 1 instances... {{(pid=130229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:04:12.873333 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:04:13.038158 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b61f5b63-cec9-47e0-be8b-f6555193d9fd tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:13.039015 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b61f5b63-cec9-47e0-be8b-f6555193d9fd tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:13.046218 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b61f5b63-cec9-47e0-be8b-f6555193d9fd tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:13.046791 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b61f5b63-cec9-47e0-be8b-f6555193d9fd tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:13.047654 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b61f5b63-cec9-47e0-be8b-f6555193d9fd tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:13.048169 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b61f5b63-cec9-47e0-be8b-f6555193d9fd tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:13.053364 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:13.071364 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d320b8fe-e477-44be-aa35-1e27a6e9ce01 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.467971 Jun 16 19:04:13.077499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 506/975] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 19:04:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:04:13.083485 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-22f215ef-ba85-4509-8515-ab0570a5a7b2 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:13.084490 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-22f215ef-ba85-4509-8515-ab0570a5a7b2 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:13.180708 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-22f215ef-ba85-4509-8515-ab0570a5a7b2 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:13.189755 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-22f215ef-ba85-4509-8515-ab0570a5a7b2 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1241 microversion: 2.1 time: 0.110786 Jun 16 19:04:13.205771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 507/976] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:13 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:13.289431 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b61f5b63-cec9-47e0-be8b-f6555193d9fd tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:13.289431 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b61f5b63-cec9-47e0-be8b-f6555193d9fd tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1265 microversion: 2.1 time: 0.254909 Jun 16 19:04:13.289431 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 470/977] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:13 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:13.715965 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-9827e62a-533e-4d18-8a37-36a36e6f3f8f req-d0b72ba3-dcc6-45b7-a3e1-fda535fda137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a203db16-039d-4c2c-a21e-5aa580925c32", "tag": "6d4aa5df-a84e-4c59-8dff-6b5e4eeefb86"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:13.734441 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-9827e62a-533e-4d18-8a37-36a36e6f3f8f req-d0b72ba3-dcc6-45b7-a3e1-fda535fda137 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:13.734938 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-9827e62a-533e-4d18-8a37-36a36e6f3f8f req-d0b72ba3-dcc6-45b7-a3e1-fda535fda137 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:13.747541 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-9827e62a-533e-4d18-8a37-36a36e6f3f8f req-d0b72ba3-dcc6-45b7-a3e1-fda535fda137 service nova] Creating event network-changed:6d4aa5df-a84e-4c59-8dff-6b5e4eeefb86 for instance a203db16-039d-4c2c-a21e-5aa580925c32 on hv-cinder-84617 Jun 16 19:04:13.752687 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-9827e62a-533e-4d18-8a37-36a36e6f3f8f req-d0b72ba3-dcc6-45b7-a3e1-fda535fda137 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040248 Jun 16 19:04:13.753723 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 508/978] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:14.207431 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-eec70d10-f9d1-4990-9f19-97a6cc0e7201 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:14.208143 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-eec70d10-f9d1-4990-9f19-97a6cc0e7201 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:14.291144 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-eec70d10-f9d1-4990-9f19-97a6cc0e7201 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:14.297960 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-eec70d10-f9d1-4990-9f19-97a6cc0e7201 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1241 microversion: 2.1 time: 0.094334 Jun 16 19:04:14.298645 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 471/979] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:14 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:14.306293 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-28f31121-4b60-443f-b8af-2d9393c67030 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:14.307821 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-28f31121-4b60-443f-b8af-2d9393c67030 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:14.316184 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-28f31121-4b60-443f-b8af-2d9393c67030 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:14.316632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-28f31121-4b60-443f-b8af-2d9393c67030 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:14.317625 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-28f31121-4b60-443f-b8af-2d9393c67030 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:14.319002 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-28f31121-4b60-443f-b8af-2d9393c67030 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:14.515496 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-28f31121-4b60-443f-b8af-2d9393c67030 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:14.523099 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-28f31121-4b60-443f-b8af-2d9393c67030 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1265 microversion: 2.1 time: 0.221675 Jun 16 19:04:14.523661 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 509/980] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:14 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:15.319494 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9efb62c0-165b-4fa0-b985-e302a0b98266 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:15.320396 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9efb62c0-165b-4fa0-b985-e302a0b98266 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:15.331929 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9efb62c0-165b-4fa0-b985-e302a0b98266 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:15.336949 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9efb62c0-165b-4fa0-b985-e302a0b98266 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:15.336949 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9efb62c0-165b-4fa0-b985-e302a0b98266 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:15.336949 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9efb62c0-165b-4fa0-b985-e302a0b98266 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:15.415157 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9efb62c0-165b-4fa0-b985-e302a0b98266 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:15.422468 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9efb62c0-165b-4fa0-b985-e302a0b98266 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1293 microversion: 2.1 time: 0.110337 Jun 16 19:04:15.424562 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 472/981] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:15 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:15.540912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-11363969-3a4a-4e93-9cb9-1fc8db511c03 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:15.541643 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-11363969-3a4a-4e93-9cb9-1fc8db511c03 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:15.548379 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-11363969-3a4a-4e93-9cb9-1fc8db511c03 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:15.550556 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-11363969-3a4a-4e93-9cb9-1fc8db511c03 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:15.550556 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-11363969-3a4a-4e93-9cb9-1fc8db511c03 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:15.550556 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-11363969-3a4a-4e93-9cb9-1fc8db511c03 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:15.682002 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-11363969-3a4a-4e93-9cb9-1fc8db511c03 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:15.689861 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-11363969-3a4a-4e93-9cb9-1fc8db511c03 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1265 microversion: 2.1 time: 0.153774 Jun 16 19:04:15.690425 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 510/982] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:15 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:16.439893 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-60a8373e-5013-4786-ad57-42266dcf1901 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:16.440496 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-60a8373e-5013-4786-ad57-42266dcf1901 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:16.448555 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-60a8373e-5013-4786-ad57-42266dcf1901 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:16.448555 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-60a8373e-5013-4786-ad57-42266dcf1901 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:16.449217 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-60a8373e-5013-4786-ad57-42266dcf1901 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:16.449681 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-60a8373e-5013-4786-ad57-42266dcf1901 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:16.555191 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-60a8373e-5013-4786-ad57-42266dcf1901 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:16.563771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-60a8373e-5013-4786-ad57-42266dcf1901 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1299 microversion: 2.1 time: 0.128026 Jun 16 19:04:16.564942 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 473/983] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:16 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1299 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:16.710658 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-754fd96b-d2eb-4a7b-8a63-2696ebcb76e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:16.711275 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-754fd96b-d2eb-4a7b-8a63-2696ebcb76e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:16.730153 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-754fd96b-d2eb-4a7b-8a63-2696ebcb76e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:16.730986 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-754fd96b-d2eb-4a7b-8a63-2696ebcb76e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:16.731962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-754fd96b-d2eb-4a7b-8a63-2696ebcb76e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:16.732564 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-754fd96b-d2eb-4a7b-8a63-2696ebcb76e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:16.905933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-754fd96b-d2eb-4a7b-8a63-2696ebcb76e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:16.914227 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-754fd96b-d2eb-4a7b-8a63-2696ebcb76e7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1265 microversion: 2.1 time: 0.210025 Jun 16 19:04:16.914875 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 511/984] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:16 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:17.582816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6a38663c-30f5-4605-9a77-ff13ee3435d5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:17.583457 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6a38663c-30f5-4605-9a77-ff13ee3435d5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:17.590189 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:17.590975 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:17.592760 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6a38663c-30f5-4605-9a77-ff13ee3435d5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:17.593515 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6a38663c-30f5-4605-9a77-ff13ee3435d5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:17.594374 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6a38663c-30f5-4605-9a77-ff13ee3435d5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:17.594826 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6a38663c-30f5-4605-9a77-ff13ee3435d5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:17.791552 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6a38663c-30f5-4605-9a77-ff13ee3435d5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:17.799232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6a38663c-30f5-4605-9a77-ff13ee3435d5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1367 microversion: 2.1 time: 0.221249 Jun 16 19:04:17.799852 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 474/985] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:17 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:17.930600 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d2007673-c1dc-4b9a-a958-1a4283f96633 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:17.931212 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d2007673-c1dc-4b9a-a958-1a4283f96633 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:17.937722 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d2007673-c1dc-4b9a-a958-1a4283f96633 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:17.938173 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d2007673-c1dc-4b9a-a958-1a4283f96633 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:17.938943 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d2007673-c1dc-4b9a-a958-1a4283f96633 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:17.939376 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d2007673-c1dc-4b9a-a958-1a4283f96633 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:17.990601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-607861e3-6777-4aa7-a7a6-22bb35160223 req-88db0540-93cf-4272-81e7-0a95c6fae424 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a69da73-7a7e-4f27-b52f-1bec2f65f145", "tag": "dc6d3d2a-8aa4-44da-b96a-930f2a198820"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:17.999902 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-607861e3-6777-4aa7-a7a6-22bb35160223 req-88db0540-93cf-4272-81e7-0a95c6fae424 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:18.005200 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-607861e3-6777-4aa7-a7a6-22bb35160223 req-88db0540-93cf-4272-81e7-0a95c6fae424 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:18.019219 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-607861e3-6777-4aa7-a7a6-22bb35160223 req-88db0540-93cf-4272-81e7-0a95c6fae424 service nova] Creating event network-changed:dc6d3d2a-8aa4-44da-b96a-930f2a198820 for instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 on hv-cinder-84617 Jun 16 19:04:18.026470 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-607861e3-6777-4aa7-a7a6-22bb35160223 req-88db0540-93cf-4272-81e7-0a95c6fae424 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040821 Jun 16 19:04:18.028677 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 475/986] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:18.149642 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d2007673-c1dc-4b9a-a958-1a4283f96633 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:18.158270 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d2007673-c1dc-4b9a-a958-1a4283f96633 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1265 microversion: 2.1 time: 0.231353 Jun 16 19:04:18.159740 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 512/987] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:17 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:18.816378 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d145f207-60a7-440c-ae04-e3f34aee0c95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:18.817083 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d145f207-60a7-440c-ae04-e3f34aee0c95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:18.824898 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d145f207-60a7-440c-ae04-e3f34aee0c95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:18.825390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d145f207-60a7-440c-ae04-e3f34aee0c95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:18.826170 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d145f207-60a7-440c-ae04-e3f34aee0c95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:18.826604 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d145f207-60a7-440c-ae04-e3f34aee0c95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:19.014231 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d145f207-60a7-440c-ae04-e3f34aee0c95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:19.022008 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d145f207-60a7-440c-ae04-e3f34aee0c95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1367 microversion: 2.1 time: 0.209815 Jun 16 19:04:19.026112 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 476/988] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:18 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:19.174311 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0a0ff99a-dc57-4d82-bf9b-8a79974b92ae tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:19.175001 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0a0ff99a-dc57-4d82-bf9b-8a79974b92ae tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:19.177441 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:19.182767 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a0ff99a-dc57-4d82-bf9b-8a79974b92ae tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:19.184228 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a0ff99a-dc57-4d82-bf9b-8a79974b92ae tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:19.184228 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a0ff99a-dc57-4d82-bf9b-8a79974b92ae tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:19.184437 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a0ff99a-dc57-4d82-bf9b-8a79974b92ae tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:19.318320 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0a0ff99a-dc57-4d82-bf9b-8a79974b92ae tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:19.330074 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0a0ff99a-dc57-4d82-bf9b-8a79974b92ae tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1265 microversion: 2.1 time: 0.159481 Jun 16 19:04:19.331840 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 513/989] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:19 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:20.038719 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-55743492-6859-4a57-9914-a60482f96a9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:20.039326 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-55743492-6859-4a57-9914-a60482f96a9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:20.045970 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-55743492-6859-4a57-9914-a60482f96a9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.046425 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-55743492-6859-4a57-9914-a60482f96a9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.047227 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-55743492-6859-4a57-9914-a60482f96a9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.047672 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-55743492-6859-4a57-9914-a60482f96a9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.181858 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-55743492-6859-4a57-9914-a60482f96a9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:20.189198 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-55743492-6859-4a57-9914-a60482f96a9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1367 microversion: 2.1 time: 0.154321 Jun 16 19:04:20.189801 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 477/990] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:20 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:20.352932 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f8eeb7e4-06d7-4a80-b1da-f8ef6f7d4a78 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:20.353594 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f8eeb7e4-06d7-4a80-b1da-f8ef6f7d4a78 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:20.360222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f8eeb7e4-06d7-4a80-b1da-f8ef6f7d4a78 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.360679 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f8eeb7e4-06d7-4a80-b1da-f8ef6f7d4a78 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.361485 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f8eeb7e4-06d7-4a80-b1da-f8ef6f7d4a78 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.361925 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f8eeb7e4-06d7-4a80-b1da-f8ef6f7d4a78 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.491133 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f8eeb7e4-06d7-4a80-b1da-f8ef6f7d4a78 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:20.498549 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f8eeb7e4-06d7-4a80-b1da-f8ef6f7d4a78 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1265 microversion: 2.1 time: 0.150362 Jun 16 19:04:20.499117 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 514/991] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:20 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:21.206680 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5493a8cb-3451-48a5-8aaf-100f0573ce9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:21.207269 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5493a8cb-3451-48a5-8aaf-100f0573ce9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:21.213296 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5493a8cb-3451-48a5-8aaf-100f0573ce9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:21.213740 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5493a8cb-3451-48a5-8aaf-100f0573ce9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:21.214490 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5493a8cb-3451-48a5-8aaf-100f0573ce9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:21.214922 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5493a8cb-3451-48a5-8aaf-100f0573ce9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:21.341420 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5493a8cb-3451-48a5-8aaf-100f0573ce9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:21.349538 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5493a8cb-3451-48a5-8aaf-100f0573ce9d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1367 microversion: 2.1 time: 0.146399 Jun 16 19:04:21.350099 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 478/992] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:21 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:21.515870 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7011faaa-7792-498b-9a8a-eb91a58d4bc4 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:21.516413 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7011faaa-7792-498b-9a8a-eb91a58d4bc4 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:21.523405 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7011faaa-7792-498b-9a8a-eb91a58d4bc4 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:21.523855 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7011faaa-7792-498b-9a8a-eb91a58d4bc4 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:21.524889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7011faaa-7792-498b-9a8a-eb91a58d4bc4 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:21.525359 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7011faaa-7792-498b-9a8a-eb91a58d4bc4 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:21.656862 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7011faaa-7792-498b-9a8a-eb91a58d4bc4 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:21.664855 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7011faaa-7792-498b-9a8a-eb91a58d4bc4 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1265 microversion: 2.1 time: 0.152953 Jun 16 19:04:21.665430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 515/993] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:21 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:22.367422 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-343b1459-1864-4d67-b08d-01bb33783329 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:22.367422 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-343b1459-1864-4d67-b08d-01bb33783329 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:22.373898 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-343b1459-1864-4d67-b08d-01bb33783329 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:22.374557 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-343b1459-1864-4d67-b08d-01bb33783329 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:22.375327 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-343b1459-1864-4d67-b08d-01bb33783329 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:22.375765 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-343b1459-1864-4d67-b08d-01bb33783329 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:22.444792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-0540d342-67dc-49df-bc03-3c3ac4fcae8b req-fd407a76-1fe5-4837-b63e-a90ddf91d629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a69da73-7a7e-4f27-b52f-1bec2f65f145", "name": "network-vif-plugged", "status": "completed", "tag": "dc6d3d2a-8aa4-44da-b96a-930f2a198820"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:22.453854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-0540d342-67dc-49df-bc03-3c3ac4fcae8b req-fd407a76-1fe5-4837-b63e-a90ddf91d629 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:22.454301 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-0540d342-67dc-49df-bc03-3c3ac4fcae8b req-fd407a76-1fe5-4837-b63e-a90ddf91d629 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:22.473620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-0540d342-67dc-49df-bc03-3c3ac4fcae8b req-fd407a76-1fe5-4837-b63e-a90ddf91d629 service nova] Creating event network-vif-plugged:dc6d3d2a-8aa4-44da-b96a-930f2a198820 for instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 on hv-cinder-84617 Jun 16 19:04:22.479174 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-0540d342-67dc-49df-bc03-3c3ac4fcae8b req-fd407a76-1fe5-4837-b63e-a90ddf91d629 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038189 Jun 16 19:04:22.479964 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 516/994] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:04:22.511873 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-343b1459-1864-4d67-b08d-01bb33783329 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:22.521192 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-343b1459-1864-4d67-b08d-01bb33783329 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1367 microversion: 2.1 time: 0.158290 Jun 16 19:04:22.521792 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 479/995] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:22 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:22.683173 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-66c2d888-514a-4515-b3f5-b31633b28b07 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:22.683877 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-66c2d888-514a-4515-b3f5-b31633b28b07 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:22.690365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-66c2d888-514a-4515-b3f5-b31633b28b07 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:22.690805 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-66c2d888-514a-4515-b3f5-b31633b28b07 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:22.691567 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-66c2d888-514a-4515-b3f5-b31633b28b07 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:22.691994 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-66c2d888-514a-4515-b3f5-b31633b28b07 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:22.833023 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:22.870986 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-66c2d888-514a-4515-b3f5-b31633b28b07 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:22.878768 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-66c2d888-514a-4515-b3f5-b31633b28b07 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1265 microversion: 2.1 time: 0.200248 Jun 16 19:04:22.879341 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 517/996] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:22 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:23.538831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9c2b920b-8994-44a2-89fa-61dffd86ef08 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:23.539448 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9c2b920b-8994-44a2-89fa-61dffd86ef08 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:23.546253 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c2b920b-8994-44a2-89fa-61dffd86ef08 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:23.546708 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c2b920b-8994-44a2-89fa-61dffd86ef08 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:23.547467 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c2b920b-8994-44a2-89fa-61dffd86ef08 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:23.547897 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c2b920b-8994-44a2-89fa-61dffd86ef08 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:23.675648 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9c2b920b-8994-44a2-89fa-61dffd86ef08 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:23.683742 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9c2b920b-8994-44a2-89fa-61dffd86ef08 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1367 microversion: 2.1 time: 0.149406 Jun 16 19:04:23.684315 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 480/997] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:23 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:23.896022 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-810349f8-2503-4d26-9350-6f03197e3272 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:23.896655 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-810349f8-2503-4d26-9350-6f03197e3272 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:23.898917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=10 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:23.904272 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-810349f8-2503-4d26-9350-6f03197e3272 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:23.904716 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-810349f8-2503-4d26-9350-6f03197e3272 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:23.905499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-810349f8-2503-4d26-9350-6f03197e3272 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:23.905932 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-810349f8-2503-4d26-9350-6f03197e3272 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:24.043319 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-810349f8-2503-4d26-9350-6f03197e3272 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:24.051199 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-810349f8-2503-4d26-9350-6f03197e3272 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1265 microversion: 2.1 time: 0.159604 Jun 16 19:04:24.051806 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 518/998] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:23 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:24.497778 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-7d26312a-51b4-446f-be4c-82dde12b4471 req-28faf97b-e537-44be-9403-0353660e290d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a203db16-039d-4c2c-a21e-5aa580925c32", "name": "network-vif-plugged", "status": "completed", "tag": "6d4aa5df-a84e-4c59-8dff-6b5e4eeefb86"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:24.501280 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=12 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:24.506541 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-7d26312a-51b4-446f-be4c-82dde12b4471 req-28faf97b-e537-44be-9403-0353660e290d service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:24.506982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-7d26312a-51b4-446f-be4c-82dde12b4471 req-28faf97b-e537-44be-9403-0353660e290d service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:24.517909 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-7d26312a-51b4-446f-be4c-82dde12b4471 req-28faf97b-e537-44be-9403-0353660e290d service nova] Creating event network-vif-plugged:6d4aa5df-a84e-4c59-8dff-6b5e4eeefb86 for instance a203db16-039d-4c2c-a21e-5aa580925c32 on hv-cinder-84617 Jun 16 19:04:24.523306 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-7d26312a-51b4-446f-be4c-82dde12b4471 req-28faf97b-e537-44be-9403-0353660e290d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029221 Jun 16 19:04:24.523884 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 481/999] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:24.700421 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1513a6c5-da2c-4e1f-a84c-fee6f1ed1dc5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:24.701029 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-1513a6c5-da2c-4e1f-a84c-fee6f1ed1dc5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:24.707030 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1513a6c5-da2c-4e1f-a84c-fee6f1ed1dc5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:24.707474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1513a6c5-da2c-4e1f-a84c-fee6f1ed1dc5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:24.708725 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1513a6c5-da2c-4e1f-a84c-fee6f1ed1dc5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:24.709164 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1513a6c5-da2c-4e1f-a84c-fee6f1ed1dc5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:24.835520 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1513a6c5-da2c-4e1f-a84c-fee6f1ed1dc5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:24.843051 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-1513a6c5-da2c-4e1f-a84c-fee6f1ed1dc5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1557 microversion: 2.1 time: 0.146476 Jun 16 19:04:24.843624 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 519/1000] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:24 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:24.860899 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c699551d-962e-4a58-ad0f-3600b492b6c1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:24.861636 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-c699551d-962e-4a58-ad0f-3600b492b6c1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:24.868683 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c699551d-962e-4a58-ad0f-3600b492b6c1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:24.869124 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c699551d-962e-4a58-ad0f-3600b492b6c1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:24.869917 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c699551d-962e-4a58-ad0f-3600b492b6c1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:24.870348 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c699551d-962e-4a58-ad0f-3600b492b6c1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:24.960571 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-c699551d-962e-4a58-ad0f-3600b492b6c1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104320 Jun 16 19:04:24.961171 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 482/1001] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jun 16 19:04:24 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:25.068664 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3661da08-c8c4-4e30-b7c1-9ced7f85804b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:25.069302 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3661da08-c8c4-4e30-b7c1-9ced7f85804b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:25.075667 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3661da08-c8c4-4e30-b7c1-9ced7f85804b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:25.076118 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3661da08-c8c4-4e30-b7c1-9ced7f85804b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:25.079282 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3661da08-c8c4-4e30-b7c1-9ced7f85804b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:25.079282 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3661da08-c8c4-4e30-b7c1-9ced7f85804b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:25.211156 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3661da08-c8c4-4e30-b7c1-9ced7f85804b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:25.218749 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3661da08-c8c4-4e30-b7c1-9ced7f85804b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1265 microversion: 2.1 time: 0.154665 Jun 16 19:04:25.219538 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 520/1002] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:25 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:25.917926 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-eb7b8da3-d1f2-48fb-b883-06b8eff8f9a6 req-62d4f075-1967-48a6-919e-07ad85d67820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a69da73-7a7e-4f27-b52f-1bec2f65f145", "tag": "dc6d3d2a-8aa4-44da-b96a-930f2a198820"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:25.926226 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-eb7b8da3-d1f2-48fb-b883-06b8eff8f9a6 req-62d4f075-1967-48a6-919e-07ad85d67820 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:25.926792 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-eb7b8da3-d1f2-48fb-b883-06b8eff8f9a6 req-62d4f075-1967-48a6-919e-07ad85d67820 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:25.939299 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-eb7b8da3-d1f2-48fb-b883-06b8eff8f9a6 req-62d4f075-1967-48a6-919e-07ad85d67820 service nova] Creating event network-changed:dc6d3d2a-8aa4-44da-b96a-930f2a198820 for instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 on hv-cinder-84617 Jun 16 19:04:25.945544 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-eb7b8da3-d1f2-48fb-b883-06b8eff8f9a6 req-62d4f075-1967-48a6-919e-07ad85d67820 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031720 Jun 16 19:04:25.946390 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 483/1003] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:26.236031 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c80a4081-d1e4-44a1-8735-f5ce0164de36 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:26.236680 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c80a4081-d1e4-44a1-8735-f5ce0164de36 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:26.243746 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c80a4081-d1e4-44a1-8735-f5ce0164de36 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:26.244220 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c80a4081-d1e4-44a1-8735-f5ce0164de36 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:26.245015 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c80a4081-d1e4-44a1-8735-f5ce0164de36 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:26.245487 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c80a4081-d1e4-44a1-8735-f5ce0164de36 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:26.713395 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c80a4081-d1e4-44a1-8735-f5ce0164de36 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:26.721106 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c80a4081-d1e4-44a1-8735-f5ce0164de36 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1452 microversion: 2.1 time: 0.489024 Jun 16 19:04:26.721691 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 521/1004] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:26 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1452 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:26.738013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-88d3a12b-9b65-46f6-a53c-3e1777b4146d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:26.739249 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-88d3a12b-9b65-46f6-a53c-3e1777b4146d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:26.745764 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-88d3a12b-9b65-46f6-a53c-3e1777b4146d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:26.746258 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-88d3a12b-9b65-46f6-a53c-3e1777b4146d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:26.747108 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-88d3a12b-9b65-46f6-a53c-3e1777b4146d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:26.747538 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-88d3a12b-9b65-46f6-a53c-3e1777b4146d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:26.960578 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-88d3a12b-9b65-46f6-a53c-3e1777b4146d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:26.968317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-88d3a12b-9b65-46f6-a53c-3e1777b4146d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1452 microversion: 2.1 time: 0.234639 Jun 16 19:04:26.968885 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 484/1005] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:26 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1452 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:29.066566 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-f9eec9aa-cb02-42f5-a278-7923e9c7f26f req-7fbfa118-208b-4ab1-9c6f-9b84908cf9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a203db16-039d-4c2c-a21e-5aa580925c32", "tag": "6d4aa5df-a84e-4c59-8dff-6b5e4eeefb86"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:29.075046 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-f9eec9aa-cb02-42f5-a278-7923e9c7f26f req-7fbfa118-208b-4ab1-9c6f-9b84908cf9b8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:29.075490 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-f9eec9aa-cb02-42f5-a278-7923e9c7f26f req-7fbfa118-208b-4ab1-9c6f-9b84908cf9b8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:29.086845 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-f9eec9aa-cb02-42f5-a278-7923e9c7f26f req-7fbfa118-208b-4ab1-9c6f-9b84908cf9b8 service nova] Creating event network-changed:6d4aa5df-a84e-4c59-8dff-6b5e4eeefb86 for instance a203db16-039d-4c2c-a21e-5aa580925c32 on hv-cinder-84617 Jun 16 19:04:29.091837 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-f9eec9aa-cb02-42f5-a278-7923e9c7f26f req-7fbfa118-208b-4ab1-9c6f-9b84908cf9b8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028975 Jun 16 19:04:29.093216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 522/1006] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:01.997174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-78a9c1a4-b15e-4a34-abae-03cba23e30ce tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:01.999608 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-78a9c1a4-b15e-4a34-abae-03cba23e30ce tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:02.001138 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=20 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:02.002109 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=68 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:02.009377 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-78a9c1a4-b15e-4a34-abae-03cba23e30ce tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:02.009971 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-78a9c1a4-b15e-4a34-abae-03cba23e30ce tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:02.011098 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-78a9c1a4-b15e-4a34-abae-03cba23e30ce tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:02.011757 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-78a9c1a4-b15e-4a34-abae-03cba23e30ce tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:02.096339 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-78a9c1a4-b15e-4a34-abae-03cba23e30ce tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145/ips" status: 200 len: 150 microversion: 2.1 time: 0.104308 Jun 16 19:05:02.096917 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 485/1007] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jun 16 19:05:01 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145/ips => generated 150 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:03.897783 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=19 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:03.898542 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=84 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:03.903092 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-96d267b5-96b9-4f89-8ac0-afdd2cd9b3f5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ca257c1-7eb3-40f9-b672-d41f641f4008"}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:03.907403 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-96d267b5-96b9-4f89-8ac0-afdd2cd9b3f5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:03.910443 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-96d267b5-96b9-4f89-8ac0-afdd2cd9b3f5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:03.910893 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-96d267b5-96b9-4f89-8ac0-afdd2cd9b3f5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:03.911714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-96d267b5-96b9-4f89-8ac0-afdd2cd9b3f5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:03.912163 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-96d267b5-96b9-4f89-8ac0-afdd2cd9b3f5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:04.930066 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-96d267b5-96b9-4f89-8ac0-afdd2cd9b3f5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "POST /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.033760 Jun 16 19:05:04.930734 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 523/1008] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jun 16 19:05:03 2022] POST /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145/os-volume_attachments => generated 194 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:12.406411 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c5b824a4-24c6-47e0-885f-50edb2404a2f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Action: 'create', calling method: .version_select at 0x7f2014054430>, body: {"keypair": {"name": "tempest-keypair-1927784630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbvu1ksPK+aZ3xEUTs1B7cbegeX9E5fgD+pwH3MBOgkjGe9AXCt7FFnt+2dm3Etz+xb1AdQ50PTnj88yz40TcGPNfxOpcn5BIOEGLdgBHITv1R/1kxTMJnqpoZWgMyP4g=="}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:12.411273 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:12.422538 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-c5b824a4-24c6-47e0-885f-50edb2404a2f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'key_pairs'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:05:12.426386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-c5b824a4-24c6-47e0-885f-50edb2404a2f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for user 06722257713746f697d1f609c3956e05 and project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'key_pairs'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:05:12.560015 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-c5b824a4-24c6-47e0-885f-50edb2404a2f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158024 Jun 16 19:05:12.561877 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 486/1009] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jun 16 19:05:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:15.499379 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-48082316", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f5b1bf4-16e2-474a-b72c-6a89096e68f2"}], "security_groups": [{"name": "tempest-securitygroup--803080325"}], "key_name": "tempest-keypair-1927784630", "user_data": "}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:15.507735 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:15.508497 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:15.612947 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.network.neutron [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] validate_networks() for [('9f5b1bf4-16e2-474a-b72c-6a89096e68f2', None, None, None, None, None)] {{(pid=130229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:05:15.981623 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Flavor limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:05:15.982044 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Image limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:05:15.982515 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Flavor pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:05:15.982919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Image pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:05:15.983353 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:05:15.992772 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:15.993212 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:15.994076 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:15.994464 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:16.010988 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:05:16.014876 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for user 06722257713746f697d1f609c3956e05 and project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:05:16.025871 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Going to run 1 instances... {{(pid=130229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:05:16.028209 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:05:16.160676 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-48d43d68-6266-465a-b44e-c9c1d3096f20 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.665765 Jun 16 19:05:16.161399 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 524/1010] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 19:05:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:05:16.179649 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-093aec0e-18b1-4ef1-80bb-a8a58d07cac1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:16.181274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-093aec0e-18b1-4ef1-80bb-a8a58d07cac1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:16.237481 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-093aec0e-18b1-4ef1-80bb-a8a58d07cac1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:16.244985 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-093aec0e-18b1-4ef1-80bb-a8a58d07cac1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 200 len: 1240 microversion: 2.1 time: 0.074231 Jun 16 19:05:16.245571 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 487/1011] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:16 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:17.263020 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-69e1831b-7161-47f1-8516-dec22a363850 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:17.263495 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-69e1831b-7161-47f1-8516-dec22a363850 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:17.272657 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-69e1831b-7161-47f1-8516-dec22a363850 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:17.273110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-69e1831b-7161-47f1-8516-dec22a363850 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:17.273975 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-69e1831b-7161-47f1-8516-dec22a363850 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:17.274413 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-69e1831b-7161-47f1-8516-dec22a363850 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:17.337891 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-69e1831b-7161-47f1-8516-dec22a363850 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:17.347508 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-69e1831b-7161-47f1-8516-dec22a363850 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 200 len: 1244 microversion: 2.1 time: 0.088902 Jun 16 19:05:17.351603 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 525/1012] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:17 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:05:18.364847 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-27723eeb-deed-4556-bf74-5e42bf68db7f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:18.365752 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-27723eeb-deed-4556-bf74-5e42bf68db7f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:18.372172 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-27723eeb-deed-4556-bf74-5e42bf68db7f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:18.372711 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-27723eeb-deed-4556-bf74-5e42bf68db7f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:18.373593 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-27723eeb-deed-4556-bf74-5e42bf68db7f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:18.374038 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-27723eeb-deed-4556-bf74-5e42bf68db7f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:18.461436 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-27723eeb-deed-4556-bf74-5e42bf68db7f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:18.470687 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-27723eeb-deed-4556-bf74-5e42bf68db7f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 200 len: 1300 microversion: 2.1 time: 0.109642 Jun 16 19:05:18.471274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 488/1013] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:18 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:19.488214 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-601a883e-edc1-4bd3-824f-f3c90781f50a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:19.488753 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-601a883e-edc1-4bd3-824f-f3c90781f50a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:19.495394 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-601a883e-edc1-4bd3-824f-f3c90781f50a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:19.495848 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-601a883e-edc1-4bd3-824f-f3c90781f50a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:19.496636 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-601a883e-edc1-4bd3-824f-f3c90781f50a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:19.497122 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-601a883e-edc1-4bd3-824f-f3c90781f50a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:19.654722 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-601a883e-edc1-4bd3-824f-f3c90781f50a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:19.662811 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-601a883e-edc1-4bd3-824f-f3c90781f50a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 200 len: 1365 microversion: 2.1 time: 0.178623 Jun 16 19:05:19.663375 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 526/1014] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:19 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:20.052012 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-53e01468-b906-423c-91d1-c6eb61196e4e req-3d323ed9-8d8a-454e-8443-be18eafa5303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca7511d-0f9a-4fb8-b715-402bd7ddef94", "tag": "aa03e150-df6e-4129-9d3c-01edb7668600"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:20.060597 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-53e01468-b906-423c-91d1-c6eb61196e4e req-3d323ed9-8d8a-454e-8443-be18eafa5303 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:20.061453 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-53e01468-b906-423c-91d1-c6eb61196e4e req-3d323ed9-8d8a-454e-8443-be18eafa5303 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:20.079902 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-53e01468-b906-423c-91d1-c6eb61196e4e req-3d323ed9-8d8a-454e-8443-be18eafa5303 service nova] Creating event network-changed:aa03e150-df6e-4129-9d3c-01edb7668600 for instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 on hv-cinder-84617 Jun 16 19:05:20.085058 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-53e01468-b906-423c-91d1-c6eb61196e4e req-3d323ed9-8d8a-454e-8443-be18eafa5303 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036694 Jun 16 19:05:20.085711 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 489/1015] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:05:20.679441 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6c082414-06c7-413b-a8df-92390749d216 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:20.680007 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6c082414-06c7-413b-a8df-92390749d216 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:20.686620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c082414-06c7-413b-a8df-92390749d216 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:20.687148 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c082414-06c7-413b-a8df-92390749d216 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:20.687920 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c082414-06c7-413b-a8df-92390749d216 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:20.688355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6c082414-06c7-413b-a8df-92390749d216 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:20.864356 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6c082414-06c7-413b-a8df-92390749d216 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:20.871755 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6c082414-06c7-413b-a8df-92390749d216 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 200 len: 1365 microversion: 2.1 time: 0.196229 Jun 16 19:05:20.879482 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 527/1016] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:20 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:21.888984 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a9ce33bd-08ce-43d3-bcd7-d9aec2b55798 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:21.889715 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a9ce33bd-08ce-43d3-bcd7-d9aec2b55798 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:21.896683 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a9ce33bd-08ce-43d3-bcd7-d9aec2b55798 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:21.897141 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a9ce33bd-08ce-43d3-bcd7-d9aec2b55798 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:21.897927 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a9ce33bd-08ce-43d3-bcd7-d9aec2b55798 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:21.898367 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a9ce33bd-08ce-43d3-bcd7-d9aec2b55798 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:22.024865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-a9ce33bd-08ce-43d3-bcd7-d9aec2b55798 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:22.032902 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a9ce33bd-08ce-43d3-bcd7-d9aec2b55798 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 200 len: 1365 microversion: 2.1 time: 0.148664 Jun 16 19:05:22.033479 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 490/1017] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:21 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:23.049762 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-fcb0790e-35fc-4cd4-b424-39fc928f47dc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:23.050365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-fcb0790e-35fc-4cd4-b424-39fc928f47dc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:23.056774 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fcb0790e-35fc-4cd4-b424-39fc928f47dc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:23.057219 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fcb0790e-35fc-4cd4-b424-39fc928f47dc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:23.058005 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fcb0790e-35fc-4cd4-b424-39fc928f47dc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:23.058438 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-fcb0790e-35fc-4cd4-b424-39fc928f47dc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:23.190004 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-fcb0790e-35fc-4cd4-b424-39fc928f47dc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:23.197374 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-fcb0790e-35fc-4cd4-b424-39fc928f47dc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 200 len: 1365 microversion: 2.1 time: 0.152068 Jun 16 19:05:23.197933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 528/1018] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:23 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:24.214163 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-cb42939a-a41c-475c-97ff-2eab7d38cec3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:24.214796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-cb42939a-a41c-475c-97ff-2eab7d38cec3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:24.221545 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cb42939a-a41c-475c-97ff-2eab7d38cec3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:24.222002 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cb42939a-a41c-475c-97ff-2eab7d38cec3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:24.222794 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cb42939a-a41c-475c-97ff-2eab7d38cec3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:24.223240 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-cb42939a-a41c-475c-97ff-2eab7d38cec3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:24.349088 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-cb42939a-a41c-475c-97ff-2eab7d38cec3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:24.356624 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-cb42939a-a41c-475c-97ff-2eab7d38cec3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 200 len: 1365 microversion: 2.1 time: 0.146344 Jun 16 19:05:24.357178 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 491/1019] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:24 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:24.574829 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-646529ad-2efc-4b04-9ab6-17661aec668d req-fca37675-f9ee-4562-a76a-d85b1f2e9e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca7511d-0f9a-4fb8-b715-402bd7ddef94", "name": "network-vif-plugged", "status": "completed", "tag": "aa03e150-df6e-4129-9d3c-01edb7668600"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:24.586593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-646529ad-2efc-4b04-9ab6-17661aec668d req-fca37675-f9ee-4562-a76a-d85b1f2e9e6d service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:24.586593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-646529ad-2efc-4b04-9ab6-17661aec668d req-fca37675-f9ee-4562-a76a-d85b1f2e9e6d service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:24.595099 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-646529ad-2efc-4b04-9ab6-17661aec668d req-fca37675-f9ee-4562-a76a-d85b1f2e9e6d service nova] Creating event network-vif-plugged:aa03e150-df6e-4129-9d3c-01edb7668600 for instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 on hv-cinder-84617 Jun 16 19:05:24.600085 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-646529ad-2efc-4b04-9ab6-17661aec668d req-fca37675-f9ee-4562-a76a-d85b1f2e9e6d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029036 Jun 16 19:05:24.600670 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 529/1020] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:25.372503 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-0733e232-2dfe-4a96-86aa-0697ddcb2def tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:25.373115 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-0733e232-2dfe-4a96-86aa-0697ddcb2def tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:25.379930 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0733e232-2dfe-4a96-86aa-0697ddcb2def tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:25.380381 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0733e232-2dfe-4a96-86aa-0697ddcb2def tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:25.381212 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0733e232-2dfe-4a96-86aa-0697ddcb2def tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:25.381680 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0733e232-2dfe-4a96-86aa-0697ddcb2def tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:25.514257 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-0733e232-2dfe-4a96-86aa-0697ddcb2def tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:25.522256 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-0733e232-2dfe-4a96-86aa-0697ddcb2def tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 200 len: 1365 microversion: 2.1 time: 0.153630 Jun 16 19:05:25.522815 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 492/1021] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:25 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:26.536786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:26.537528 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=6 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:26.541646 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-acb94ef8-a017-49ec-a591-5f5f5d03539a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:26.542350 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-acb94ef8-a017-49ec-a591-5f5f5d03539a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:26.548467 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-acb94ef8-a017-49ec-a591-5f5f5d03539a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:26.549656 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-acb94ef8-a017-49ec-a591-5f5f5d03539a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:26.549778 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-acb94ef8-a017-49ec-a591-5f5f5d03539a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:26.550122 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-acb94ef8-a017-49ec-a591-5f5f5d03539a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:26.678223 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-acb94ef8-a017-49ec-a591-5f5f5d03539a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:26.685783 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-acb94ef8-a017-49ec-a591-5f5f5d03539a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 200 len: 1555 microversion: 2.1 time: 0.150460 Jun 16 19:05:26.686332 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 530/1022] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:26 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:26.702543 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c199b5e9-bea8-4314-9db7-403635d85104 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:26.705606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-c199b5e9-bea8-4314-9db7-403635d85104 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:26.705606 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=6 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:26.710242 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c199b5e9-bea8-4314-9db7-403635d85104 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:26.710695 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c199b5e9-bea8-4314-9db7-403635d85104 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:26.711469 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c199b5e9-bea8-4314-9db7-403635d85104 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:26.711908 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c199b5e9-bea8-4314-9db7-403635d85104 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:26.787274 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-c199b5e9-bea8-4314-9db7-403635d85104 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088569 Jun 16 19:05:26.787846 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 493/1023] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jun 16 19:05:26 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:27.987375 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-0ef9c17b-7e9b-4fab-a4bf-6dd83b7e2c74 req-fca02bb2-ccb8-4512-b1f3-30ae0806bba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca7511d-0f9a-4fb8-b715-402bd7ddef94", "tag": "aa03e150-df6e-4129-9d3c-01edb7668600"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:27.996500 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-0ef9c17b-7e9b-4fab-a4bf-6dd83b7e2c74 req-fca02bb2-ccb8-4512-b1f3-30ae0806bba3 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:27.996949 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-0ef9c17b-7e9b-4fab-a4bf-6dd83b7e2c74 req-fca02bb2-ccb8-4512-b1f3-30ae0806bba3 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:28.009659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-0ef9c17b-7e9b-4fab-a4bf-6dd83b7e2c74 req-fca02bb2-ccb8-4512-b1f3-30ae0806bba3 service nova] Creating event network-changed:aa03e150-df6e-4129-9d3c-01edb7668600 for instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 on hv-cinder-84617 Jun 16 19:05:28.014633 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-0ef9c17b-7e9b-4fab-a4bf-6dd83b7e2c74 req-fca02bb2-ccb8-4512-b1f3-30ae0806bba3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030914 Jun 16 19:05:28.015238 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 531/1024] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:06:02.382486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:02.383118 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e3149eb2-56cd-408e-b8f2-40d4f5ad1b45 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:02.383118 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e3149eb2-56cd-408e-b8f2-40d4f5ad1b45 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:02.385078 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=36 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:02.386108 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:02.387009 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=34 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:02.389820 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-14c40fa8-d099-4b7b-adce-e9c1c1fd386d req-3a1e3df6-8bc5-4202-876f-37c40972c825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a203db16-039d-4c2c-a21e-5aa580925c32", "tag": "6d4aa5df-a84e-4c59-8dff-6b5e4eeefb86"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:02.392257 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e3149eb2-56cd-408e-b8f2-40d4f5ad1b45 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:02.392798 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e3149eb2-56cd-408e-b8f2-40d4f5ad1b45 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:02.393600 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e3149eb2-56cd-408e-b8f2-40d4f5ad1b45 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:02.394208 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e3149eb2-56cd-408e-b8f2-40d4f5ad1b45 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:02.398598 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-14c40fa8-d099-4b7b-adce-e9c1c1fd386d req-3a1e3df6-8bc5-4202-876f-37c40972c825 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:02.401057 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-14c40fa8-d099-4b7b-adce-e9c1c1fd386d req-3a1e3df6-8bc5-4202-876f-37c40972c825 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:02.410687 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-14c40fa8-d099-4b7b-adce-e9c1c1fd386d req-3a1e3df6-8bc5-4202-876f-37c40972c825 service nova] Creating event network-changed:6d4aa5df-a84e-4c59-8dff-6b5e4eeefb86 for instance a203db16-039d-4c2c-a21e-5aa580925c32 on hv-cinder-84617 Jun 16 19:06:02.416507 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-14c40fa8-d099-4b7b-adce-e9c1c1fd386d req-3a1e3df6-8bc5-4202-876f-37c40972c825 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035421 Jun 16 19:06:02.417761 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 532/1025] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:06:02.421686 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e3149eb2-56cd-408e-b8f2-40d4f5ad1b45 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Going to try to terminate instance {{(pid=130230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:06:02.778439 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e3149eb2-56cd-408e-b8f2-40d4f5ad1b45 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 204 len: 0 microversion: 2.1 time: 0.399819 Jun 16 19:06:02.779223 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 494/1026] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:06:02 2022] DELETE /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:06:02.789197 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-88f18b61-5959-4263-b384-3be2b23a7d76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:02.790664 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-88f18b61-5959-4263-b384-3be2b23a7d76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:02.797619 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-88f18b61-5959-4263-b384-3be2b23a7d76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:02.798070 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-88f18b61-5959-4263-b384-3be2b23a7d76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:02.799067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-88f18b61-5959-4263-b384-3be2b23a7d76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:02.799735 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-88f18b61-5959-4263-b384-3be2b23a7d76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:02.941975 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-88f18b61-5959-4263-b384-3be2b23a7d76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:02.949719 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-88f18b61-5959-4263-b384-3be2b23a7d76 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1577 microversion: 2.1 time: 0.166023 Jun 16 19:06:02.950309 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 533/1027] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:02 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:03.769489 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-0f06d046-ee0d-49bd-a35b-7ef3dde31abc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:03.770062 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-0f06d046-ee0d-49bd-a35b-7ef3dde31abc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:03.777021 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0f06d046-ee0d-49bd-a35b-7ef3dde31abc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:03.777501 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0f06d046-ee0d-49bd-a35b-7ef3dde31abc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:03.778266 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0f06d046-ee0d-49bd-a35b-7ef3dde31abc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:03.778704 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0f06d046-ee0d-49bd-a35b-7ef3dde31abc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:03.800870 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-0f06d046-ee0d-49bd-a35b-7ef3dde31abc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94/ips" status: 200 len: 149 microversion: 2.1 time: 0.036045 Jun 16 19:06:03.801447 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 495/1028] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jun 16 19:06:03 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:03.811705 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d018deaa-5ba8-4566-b1ca-1fa3208b4131 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ca257c1-7eb3-40f9-b672-d41f641f4008"}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:03.812767 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d018deaa-5ba8-4566-b1ca-1fa3208b4131 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:03.819152 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d018deaa-5ba8-4566-b1ca-1fa3208b4131 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:03.819601 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d018deaa-5ba8-4566-b1ca-1fa3208b4131 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:03.820357 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d018deaa-5ba8-4566-b1ca-1fa3208b4131 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:03.820792 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d018deaa-5ba8-4566-b1ca-1fa3208b4131 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:03.898193 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-d018deaa-5ba8-4566-b1ca-1fa3208b4131 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] HTTP exception thrown: Invalid volume: volume 1ca257c1-7eb3-40f9-b672-d41f641f4008 is already attached to instances: 8a69da73-7a7e-4f27-b52f-1bec2f65f145 Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d018deaa-5ba8-4566-b1ca-1fa3208b4131 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Request method failure captured: Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: POST /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94/os-volume_attachments HTTP/1.1 Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 74 Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq36otl9Z_9Uiu0W2mg3FY9q2qgCS_Cc1PxlbzIDrBO8P3LU1ECIrM7T29od52OXBUcCnSlAwdyhzA3OZjSK1OKGpcp24QmnPZEy0Wk9nU6RvttgAU-rPxhRN2BqQnwtSWlyl3NKiQytbydUY3h7cF5WFM7v828GjpSevZojX3s7BtiE Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:06:03.900466 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:06:03.902257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cfa6530fe6dd49d88f41c57406f4cbb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cfa6530fe6dd49d88f41c57406f4cbb6"}]}] Jun 16 19:06:03.902257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:06:03.902257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:06:03.902257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:06:03.902257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:06:03.902257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:06:03.902257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:06:03.902257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 06722257713746f697d1f609c3956e05 Jun 16 19:06:03.902257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:06:03.902257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Jun 16 19:06:03.902257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {"volumeAttachment": {"volumeId": "1ca257c1-7eb3-40f9-b672-d41f641f4008"}} Jun 16 19:06:03.902257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Invalid volume: volume 1ca257c1-7eb3-40f9-b672-d41f641f4008 is already attached to instances: 8a69da73-7a7e-4f27-b52f-1bec2f65f145 Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'server_id': 'aca7511d-0f9a-4fb8-b715-402bd7ddef94', 'body': {'volumeAttachment': {'volumeId': '1ca257c1-7eb3-40f9-b672-d41f641f4008'}}} Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1ca257c1-7eb3-40f9-b672-d41f641f4008 is already attached to instances: 8a69da73-7a7e-4f27-b52f-1bec2f65f145 Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:03.903393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1ca257c1-7eb3-40f9-b672-d41f641f4008 is already attached to instances: 8a69da73-7a7e-4f27-b52f-1bec2f65f145 Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:03.904962 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:03.906686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:03.906686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:06:03.906686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:06:03.906686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1ca257c1-7eb3-40f9-b672-d41f641f4008 is already attached to instances: 8a69da73-7a7e-4f27-b52f-1bec2f65f145 Jun 16 19:06:03.906686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:03.906686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d018deaa-5ba8-4566-b1ca-1fa3208b4131 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Returning 400 to user: Invalid volume: volume 1ca257c1-7eb3-40f9-b672-d41f641f4008 is already attached to instances: 8a69da73-7a7e-4f27-b52f-1bec2f65f145 {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:06:03.906686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d018deaa-5ba8-4566-b1ca-1fa3208b4131 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "POST /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094229 Jun 16 19:06:03.906686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 534/1029] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jun 16 19:06:03 2022] POST /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:06:03.910760 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f03e8d37-4141-45d2-add9-a759ced038b6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:03.911266 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f03e8d37-4141-45d2-add9-a759ced038b6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:03.917385 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f03e8d37-4141-45d2-add9-a759ced038b6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:03.917839 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f03e8d37-4141-45d2-add9-a759ced038b6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:03.919034 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f03e8d37-4141-45d2-add9-a759ced038b6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:03.919539 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f03e8d37-4141-45d2-add9-a759ced038b6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:03.947561 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f03e8d37-4141-45d2-add9-a759ced038b6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Going to try to terminate instance {{(pid=130230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:06:03.966413 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5a1f94b9-6d4a-41c7-bc9e-5f388970b63d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:03.967351 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5a1f94b9-6d4a-41c7-bc9e-5f388970b63d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:03.973737 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5a1f94b9-6d4a-41c7-bc9e-5f388970b63d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:03.975886 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5a1f94b9-6d4a-41c7-bc9e-5f388970b63d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:03.976826 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5a1f94b9-6d4a-41c7-bc9e-5f388970b63d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:03.977550 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5a1f94b9-6d4a-41c7-bc9e-5f388970b63d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:04.115555 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-5a1f94b9-6d4a-41c7-bc9e-5f388970b63d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:04.123594 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5a1f94b9-6d4a-41c7-bc9e-5f388970b63d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1577 microversion: 2.1 time: 0.160998 Jun 16 19:06:04.124411 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 535/1030] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:03 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:04.285419 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f03e8d37-4141-45d2-add9-a759ced038b6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "DELETE /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 204 len: 0 microversion: 2.1 time: 0.378286 Jun 16 19:06:04.286018 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 496/1031] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:06:03 2022] DELETE /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:06:04.295652 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6d038eb7-3b79-4b27-a37c-050def23d87f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:04.296180 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6d038eb7-3b79-4b27-a37c-050def23d87f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:04.302438 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6d038eb7-3b79-4b27-a37c-050def23d87f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:04.302891 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6d038eb7-3b79-4b27-a37c-050def23d87f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:04.303670 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6d038eb7-3b79-4b27-a37c-050def23d87f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:04.304113 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6d038eb7-3b79-4b27-a37c-050def23d87f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:04.432136 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6d038eb7-3b79-4b27-a37c-050def23d87f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:04.439516 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6d038eb7-3b79-4b27-a37c-050def23d87f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 200 len: 1679 microversion: 2.1 time: 0.147860 Jun 16 19:06:04.440069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 536/1032] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:04 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:05.143698 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ed0472d8-4d36-4d2d-b8c5-f215dc841794 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:05.144425 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ed0472d8-4d36-4d2d-b8c5-f215dc841794 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:05.150942 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ed0472d8-4d36-4d2d-b8c5-f215dc841794 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:05.154191 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ed0472d8-4d36-4d2d-b8c5-f215dc841794 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:05.154191 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ed0472d8-4d36-4d2d-b8c5-f215dc841794 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:05.154191 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ed0472d8-4d36-4d2d-b8c5-f215dc841794 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:05.284357 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ed0472d8-4d36-4d2d-b8c5-f215dc841794 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:05.292396 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ed0472d8-4d36-4d2d-b8c5-f215dc841794 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1458 microversion: 2.1 time: 0.152986 Jun 16 19:06:05.292950 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 497/1033] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:05 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1458 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:05.456303 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6d0eb786-8a63-465d-9211-cd85f9fb2d3f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:05.456846 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6d0eb786-8a63-465d-9211-cd85f9fb2d3f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:05.463920 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6d0eb786-8a63-465d-9211-cd85f9fb2d3f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:05.464370 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6d0eb786-8a63-465d-9211-cd85f9fb2d3f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:05.465131 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6d0eb786-8a63-465d-9211-cd85f9fb2d3f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:05.465706 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6d0eb786-8a63-465d-9211-cd85f9fb2d3f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:05.589974 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6d0eb786-8a63-465d-9211-cd85f9fb2d3f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:05.597322 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6d0eb786-8a63-465d-9211-cd85f9fb2d3f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 200 len: 1679 microversion: 2.1 time: 0.144954 Jun 16 19:06:05.597882 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 537/1034] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:05 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:06.310166 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-27842df0-4678-4179-8163-11909ac5c716 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:06.311501 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-27842df0-4678-4179-8163-11909ac5c716 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:06.318278 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-27842df0-4678-4179-8163-11909ac5c716 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:06.318998 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-27842df0-4678-4179-8163-11909ac5c716 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:06.320107 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-27842df0-4678-4179-8163-11909ac5c716 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:06.320707 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-27842df0-4678-4179-8163-11909ac5c716 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:06.615606 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6332da7c-8d7e-41c8-a154-8081cbaba7f9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:06.616227 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6332da7c-8d7e-41c8-a154-8081cbaba7f9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:06.629208 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6332da7c-8d7e-41c8-a154-8081cbaba7f9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:06.629689 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6332da7c-8d7e-41c8-a154-8081cbaba7f9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:06.630459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6332da7c-8d7e-41c8-a154-8081cbaba7f9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:06.630897 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6332da7c-8d7e-41c8-a154-8081cbaba7f9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:06.677370 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-27842df0-4678-4179-8163-11909ac5c716 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:06.685523 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-27842df0-4678-4179-8163-11909ac5c716 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1458 microversion: 2.1 time: 0.379895 Jun 16 19:06:06.686092 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 498/1035] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:06 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1458 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:06:06.726894 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-5dc37ce7-ed56-4434-a224-9f93e8aac0f1 req-96d642e2-6e86-437a-91a9-4d11c45acae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a203db16-039d-4c2c-a21e-5aa580925c32", "name": "network-vif-deleted", "tag": "6d4aa5df-a84e-4c59-8dff-6b5e4eeefb86"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:06.735806 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-5dc37ce7-ed56-4434-a224-9f93e8aac0f1 req-96d642e2-6e86-437a-91a9-4d11c45acae0 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:06.736369 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-5dc37ce7-ed56-4434-a224-9f93e8aac0f1 req-96d642e2-6e86-437a-91a9-4d11c45acae0 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:06.750324 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-5dc37ce7-ed56-4434-a224-9f93e8aac0f1 req-96d642e2-6e86-437a-91a9-4d11c45acae0 service nova] Creating event network-vif-deleted:6d4aa5df-a84e-4c59-8dff-6b5e4eeefb86 for instance a203db16-039d-4c2c-a21e-5aa580925c32 on hv-cinder-84617 Jun 16 19:06:06.757416 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-5dc37ce7-ed56-4434-a224-9f93e8aac0f1 req-96d642e2-6e86-437a-91a9-4d11c45acae0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033064 Jun 16 19:06:06.757416 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 499/1036] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:06:06.850245 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6332da7c-8d7e-41c8-a154-8081cbaba7f9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:06.858740 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6332da7c-8d7e-41c8-a154-8081cbaba7f9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 200 len: 1679 microversion: 2.1 time: 0.247104 Jun 16 19:06:06.859883 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 538/1037] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:06 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 1679 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:06:07.704107 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2b2514bf-4281-45d8-86bd-2b14808d3d50 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:07.704819 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2b2514bf-4281-45d8-86bd-2b14808d3d50 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:07.720866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2b2514bf-4281-45d8-86bd-2b14808d3d50 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:07.721404 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2b2514bf-4281-45d8-86bd-2b14808d3d50 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:07.722196 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2b2514bf-4281-45d8-86bd-2b14808d3d50 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:07.722831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2b2514bf-4281-45d8-86bd-2b14808d3d50 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:07.755932 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2b2514bf-4281-45d8-86bd-2b14808d3d50 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:07.756386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2b2514bf-4281-45d8-86bd-2b14808d3d50 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:07.756838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.objects.instance [None req-2b2514bf-4281-45d8-86bd-2b14808d3d50 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lazy-loading 'fault' on Instance uuid a203db16-039d-4c2c-a21e-5aa580925c32 {{(pid=130230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:06:07.799088 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2b2514bf-4281-45d8-86bd-2b14808d3d50 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:07.806863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2b2514bf-4281-45d8-86bd-2b14808d3d50 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 200 len: 1229 microversion: 2.1 time: 0.108032 Jun 16 19:06:07.807429 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 500/1038] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:07 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 1229 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:07.876686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3e0d34a6-9a0d-4451-8ceb-092fbfec7017 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:07.877338 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3e0d34a6-9a0d-4451-8ceb-092fbfec7017 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:07.883798 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3e0d34a6-9a0d-4451-8ceb-092fbfec7017 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:07.884251 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3e0d34a6-9a0d-4451-8ceb-092fbfec7017 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:07.885028 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3e0d34a6-9a0d-4451-8ceb-092fbfec7017 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:07.885688 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3e0d34a6-9a0d-4451-8ceb-092fbfec7017 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:07.917415 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3e0d34a6-9a0d-4451-8ceb-092fbfec7017 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:07.917805 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3e0d34a6-9a0d-4451-8ceb-092fbfec7017 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:07.918243 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-3e0d34a6-9a0d-4451-8ceb-092fbfec7017 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lazy-loading 'fault' on Instance uuid aca7511d-0f9a-4fb8-b715-402bd7ddef94 {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:06:08.115870 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3e0d34a6-9a0d-4451-8ceb-092fbfec7017 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:08.125040 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3e0d34a6-9a0d-4451-8ceb-092fbfec7017 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 200 len: 1330 microversion: 2.1 time: 0.252475 Jun 16 19:06:08.125802 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 539/1039] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:07 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 1330 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:08.769913 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-738f6ce2-3ee7-4529-8dfe-93b2940d9a62 req-d2ae8157-51e8-4241-b8d2-7c5d7e392ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca7511d-0f9a-4fb8-b715-402bd7ddef94", "name": "network-vif-deleted", "tag": "aa03e150-df6e-4129-9d3c-01edb7668600"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:08.780501 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-738f6ce2-3ee7-4529-8dfe-93b2940d9a62 req-d2ae8157-51e8-4241-b8d2-7c5d7e392ed3 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:08.780501 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-738f6ce2-3ee7-4529-8dfe-93b2940d9a62 req-d2ae8157-51e8-4241-b8d2-7c5d7e392ed3 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:08.790107 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-738f6ce2-3ee7-4529-8dfe-93b2940d9a62 req-d2ae8157-51e8-4241-b8d2-7c5d7e392ed3 service nova] Creating event network-vif-deleted:aa03e150-df6e-4129-9d3c-01edb7668600 for instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 on hv-cinder-84617 Jun 16 19:06:08.795327 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-738f6ce2-3ee7-4529-8dfe-93b2940d9a62 req-d2ae8157-51e8-4241-b8d2-7c5d7e392ed3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029175 Jun 16 19:06:08.795910 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 501/1040] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:08.823463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0d830e0d-3190-44e2-8fe8-46096af91b80 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:08.824078 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0d830e0d-3190-44e2-8fe8-46096af91b80 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: a203db16-039d-4c2c-a21e-5aa580925c32] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:08.830082 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0d830e0d-3190-44e2-8fe8-46096af91b80 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:08.830551 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0d830e0d-3190-44e2-8fe8-46096af91b80 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:08.831312 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0d830e0d-3190-44e2-8fe8-46096af91b80 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:08.831749 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0d830e0d-3190-44e2-8fe8-46096af91b80 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:08.845371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-0d830e0d-3190-44e2-8fe8-46096af91b80 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] HTTP exception thrown: Instance a203db16-039d-4c2c-a21e-5aa580925c32 could not be found. Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0d830e0d-3190-44e2-8fe8-46096af91b80 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Request method failure captured: Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 HTTP/1.1 Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq30361t7E8doIA6nwYkO3vD4KCZTaRR9Q0WWFAXPQeVo3ZUvcXZScN8v32Zwpv-WHAlG6FZv-LYGnOD1MjwQttBV8Ubwx0B0WINdW_g8UesKwVW5nRA3cDgte6vHx0prOEICzTT0JXhVRtWoQWQ6wb8PoQyXRrN5cbDOSfrhmmNUgLc Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: fc32e3179c534d83b3d4108a38fb9d19 Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-TestVolumeBootPattern-1915969095 Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:06:08.846901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:06:08.848517 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fc32e3179c534d83b3d4108a38fb9d19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_fc32e3179c534d83b3d4108a38fb9d19", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fc32e3179c534d83b3d4108a38fb9d19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/fc32e3179c534d83b3d4108a38fb9d19"}]}] Jun 16 19:06:08.848517 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-TestVolumeBootPattern-1915969095 Jun 16 19:06:08.848517 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: fc32e3179c534d83b3d4108a38fb9d19 Jun 16 19:06:08.848517 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-TestVolumeBootPattern-1915969095 Jun 16 19:06:08.848517 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-TestVolumeBootPattern-1915969095-project Jun 16 19:06:08.848517 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:06:08.848517 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:06:08.848517 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 1c0e7e9f9d0f409a8820d8bd8dd239cf Jun 16 19:06:08.848517 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-TestVolumeBootPattern-1915969095-project Jun 16 19:06:08.848517 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:06:08.848517 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance a203db16-039d-4c2c-a21e-5aa580925c32 could not be found. Jun 16 19:06:08.848517 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': 'a203db16-039d-4c2c-a21e-5aa580925c32'} Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a203db16-039d-4c2c-a21e-5aa580925c32 could not be found. Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:06:08.849478 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a203db16-039d-4c2c-a21e-5aa580925c32 could not be found. Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a203db16-039d-4c2c-a21e-5aa580925c32 could not be found. Jun 16 19:06:08.850979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:08.852361 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0d830e0d-3190-44e2-8fe8-46096af91b80 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Returning 404 to user: Instance a203db16-039d-4c2c-a21e-5aa580925c32 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:06:08.852361 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0d830e0d-3190-44e2-8fe8-46096af91b80 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32" status: 404 len: 111 microversion: 2.1 time: 0.029185 Jun 16 19:06:08.852361 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 540/1041] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:08 2022] GET /compute/v2.1/servers/a203db16-039d-4c2c-a21e-5aa580925c32 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:06:09.143397 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-137e79cc-e3de-4af1-b296-d007d5b39307 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:09.146416 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-137e79cc-e3de-4af1-b296-d007d5b39307 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:09.151159 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-137e79cc-e3de-4af1-b296-d007d5b39307 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:09.151607 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-137e79cc-e3de-4af1-b296-d007d5b39307 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:09.152374 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-137e79cc-e3de-4af1-b296-d007d5b39307 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:09.152840 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-137e79cc-e3de-4af1-b296-d007d5b39307 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:09.165884 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-137e79cc-e3de-4af1-b296-d007d5b39307 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] HTTP exception thrown: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-137e79cc-e3de-4af1-b296-d007d5b39307 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Request method failure captured: Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 HTTP/1.1 Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq36otl9Z_9Uiu0W2mg3FY9q2qgCS_Cc1PxlbzIDrBO8P3LU1ECIrM7T29od52OXBUcCnSlAwdyhzA3OZjSK1OKGpcp24QmnPZEy0Wk9nU6RvttgAU-rPxhRN2BqQnwtSWlyl3NKiQytbydUY3h7cF5WFM7v828GjpSevZojX3s7BtiE Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:06:09.167511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:06:09.169207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cfa6530fe6dd49d88f41c57406f4cbb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cfa6530fe6dd49d88f41c57406f4cbb6"}]}] Jun 16 19:06:09.169207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:06:09.169207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:06:09.169207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:06:09.169207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:06:09.169207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:06:09.169207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:06:09.169207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 06722257713746f697d1f609c3956e05 Jun 16 19:06:09.169207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:06:09.169207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:06:09.169207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. Jun 16 19:06:09.169207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': 'aca7511d-0f9a-4fb8-b715-402bd7ddef94'} Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:06:09.170162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. Jun 16 19:06:09.171789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:06:09.173205 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-137e79cc-e3de-4af1-b296-d007d5b39307 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Returning 404 to user: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:06:09.173205 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-137e79cc-e3de-4af1-b296-d007d5b39307 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 404 len: 111 microversion: 2.1 time: 0.029771 Jun 16 19:06:09.173205 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 502/1042] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:09 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:06:09.177883 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-091c6a36-ce6b-4b0a-ba38-312b46846b59 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '.version_select at 0x7f2007f8a550>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:09.281610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-091c6a36-ce6b-4b0a-ba38-312b46846b59 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1927784630" status: 202 len: 0 microversion: 2.1 time: 0.107557 Jun 16 19:06:09.282168 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 541/1043] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jun 16 19:06:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1927784630 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:06:10.328349 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4bdd4db3-5f9f-4dc7-8bcb-ae403cb4b0ee tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:10.329005 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4bdd4db3-5f9f-4dc7-8bcb-ae403cb4b0ee tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:10.335565 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4bdd4db3-5f9f-4dc7-8bcb-ae403cb4b0ee tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:10.336013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4bdd4db3-5f9f-4dc7-8bcb-ae403cb4b0ee tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:10.336774 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4bdd4db3-5f9f-4dc7-8bcb-ae403cb4b0ee tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:10.337261 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4bdd4db3-5f9f-4dc7-8bcb-ae403cb4b0ee tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:10.418446 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.objects.instance [None req-4bdd4db3-5f9f-4dc7-8bcb-ae403cb4b0ee tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lazy-loading 'services' on Instance uuid 8a69da73-7a7e-4f27-b52f-1bec2f65f145 {{(pid=130230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:06:10.731926 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4bdd4db3-5f9f-4dc7-8bcb-ae403cb4b0ee tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145/os-volume_attachments/1ca257c1-7eb3-40f9-b672-d41f641f4008" status: 202 len: 0 microversion: 2.1 time: 0.407407 Jun 16 19:06:10.732524 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 503/1044] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jun 16 19:06:10 2022] DELETE /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145/os-volume_attachments/1ca257c1-7eb3-40f9-b672-d41f641f4008 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:06:10.742248 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4f83539d-4146-46f8-b377-6c3730817331 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:10.743192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4f83539d-4146-46f8-b377-6c3730817331 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:10.752796 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4f83539d-4146-46f8-b377-6c3730817331 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:10.753267 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4f83539d-4146-46f8-b377-6c3730817331 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:10.754096 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4f83539d-4146-46f8-b377-6c3730817331 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:10.754537 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4f83539d-4146-46f8-b377-6c3730817331 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:10.785864 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4f83539d-4146-46f8-b377-6c3730817331 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048892 Jun 16 19:06:10.786420 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 542/1045] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:06:10 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:11.799232 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3ed591a3-ff82-43c5-9043-762f50c97ebe tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:11.800419 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3ed591a3-ff82-43c5-9043-762f50c97ebe tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:11.807289 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3ed591a3-ff82-43c5-9043-762f50c97ebe tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:11.807738 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3ed591a3-ff82-43c5-9043-762f50c97ebe tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:11.808507 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3ed591a3-ff82-43c5-9043-762f50c97ebe tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:11.808969 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3ed591a3-ff82-43c5-9043-762f50c97ebe tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:11.837098 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3ed591a3-ff82-43c5-9043-762f50c97ebe tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042718 Jun 16 19:06:11.837678 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 504/1046] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:06:11 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:06:11.898167 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-9d5b2077-fa2e-46fb-8f92-1a8fb634e495 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:11.898670 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9d5b2077-fa2e-46fb-8f92-1a8fb634e495 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:11.905523 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9d5b2077-fa2e-46fb-8f92-1a8fb634e495 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:11.905970 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9d5b2077-fa2e-46fb-8f92-1a8fb634e495 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:11.906931 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9d5b2077-fa2e-46fb-8f92-1a8fb634e495 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:11.907366 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-9d5b2077-fa2e-46fb-8f92-1a8fb634e495 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:11.935266 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-9d5b2077-fa2e-46fb-8f92-1a8fb634e495 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Going to try to terminate instance {{(pid=130229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:06:12.240646 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-9d5b2077-fa2e-46fb-8f92-1a8fb634e495 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 204 len: 0 microversion: 2.1 time: 0.346253 Jun 16 19:06:12.241407 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 543/1047] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:06:11 2022] DELETE /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:06:12.249930 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-0e3d423c-3e98-4892-85d1-c5d11f98d060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:12.250655 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-0e3d423c-3e98-4892-85d1-c5d11f98d060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:12.257630 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0e3d423c-3e98-4892-85d1-c5d11f98d060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:12.258079 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0e3d423c-3e98-4892-85d1-c5d11f98d060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:12.260827 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0e3d423c-3e98-4892-85d1-c5d11f98d060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:12.260827 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-0e3d423c-3e98-4892-85d1-c5d11f98d060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:12.465845 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-0e3d423c-3e98-4892-85d1-c5d11f98d060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:12.473279 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-0e3d423c-3e98-4892-85d1-c5d11f98d060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1682 microversion: 2.1 time: 0.227582 Jun 16 19:06:12.473839 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 505/1048] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:12 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:12.606208 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f209211a-bc1d-433f-ace7-c9b3ba1622b7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:12.606789 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f209211a-bc1d-433f-ace7-c9b3ba1622b7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:12.608048 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-0b3221d6-1d51-4464-b942-98f360f6493c req-20966f3f-29df-4069-b645-37e214589b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b0e627a-a28a-419d-854b-63e81d67a3f7", "tag": "66d9152b-c02c-4f61-9fe8-f277bc4c64a1"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:12.613153 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f209211a-bc1d-433f-ace7-c9b3ba1622b7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:12.613627 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f209211a-bc1d-433f-ace7-c9b3ba1622b7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:12.614388 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f209211a-bc1d-433f-ace7-c9b3ba1622b7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:12.614818 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f209211a-bc1d-433f-ace7-c9b3ba1622b7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:12.616635 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-0b3221d6-1d51-4464-b942-98f360f6493c req-20966f3f-29df-4069-b645-37e214589b9f service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:12.617102 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-0b3221d6-1d51-4464-b942-98f360f6493c req-20966f3f-29df-4069-b645-37e214589b9f service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:12.629411 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-0b3221d6-1d51-4464-b942-98f360f6493c req-20966f3f-29df-4069-b645-37e214589b9f service nova] Creating event network-changed:66d9152b-c02c-4f61-9fe8-f277bc4c64a1 for instance 5b0e627a-a28a-419d-854b-63e81d67a3f7 on hv-cinder-84617 Jun 16 19:06:12.635833 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-0b3221d6-1d51-4464-b942-98f360f6493c req-20966f3f-29df-4069-b645-37e214589b9f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030814 Jun 16 19:06:12.635833 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 506/1049] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:06:12.642184 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f209211a-bc1d-433f-ace7-c9b3ba1622b7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Going to try to terminate instance {{(pid=130229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:06:12.953507 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f209211a-bc1d-433f-ace7-c9b3ba1622b7 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "DELETE /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 204 len: 0 microversion: 2.1 time: 0.351252 Jun 16 19:06:12.954207 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 544/1050] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:06:12 2022] DELETE /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:06:12.963251 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-100de9bf-ddd4-4d4c-ae08-e145bac4678d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:12.963952 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-100de9bf-ddd4-4d4c-ae08-e145bac4678d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:12.970362 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-100de9bf-ddd4-4d4c-ae08-e145bac4678d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:12.970857 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-100de9bf-ddd4-4d4c-ae08-e145bac4678d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:12.975660 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-100de9bf-ddd4-4d4c-ae08-e145bac4678d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:12.975660 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-100de9bf-ddd4-4d4c-ae08-e145bac4678d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:13.112835 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-100de9bf-ddd4-4d4c-ae08-e145bac4678d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:13.121556 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-100de9bf-ddd4-4d4c-ae08-e145bac4678d tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1578 microversion: 2.1 time: 0.162952 Jun 16 19:06:13.122116 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 507/1051] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:12 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:13.491239 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-6be45dff-305a-49a7-8309-e6f075ba4624 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:13.491844 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-6be45dff-305a-49a7-8309-e6f075ba4624 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:13.498859 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6be45dff-305a-49a7-8309-e6f075ba4624 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:13.499319 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6be45dff-305a-49a7-8309-e6f075ba4624 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:13.500104 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6be45dff-305a-49a7-8309-e6f075ba4624 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:13.500543 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-6be45dff-305a-49a7-8309-e6f075ba4624 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:13.647891 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-6be45dff-305a-49a7-8309-e6f075ba4624 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:13.656059 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-6be45dff-305a-49a7-8309-e6f075ba4624 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1682 microversion: 2.1 time: 0.169222 Jun 16 19:06:13.656612 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 545/1052] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:13 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:14.139171 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c3cdc9b1-9ef2-4fb8-aab0-cd0c2942b21f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:14.139789 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-c3cdc9b1-9ef2-4fb8-aab0-cd0c2942b21f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:14.148542 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c3cdc9b1-9ef2-4fb8-aab0-cd0c2942b21f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:14.148992 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c3cdc9b1-9ef2-4fb8-aab0-cd0c2942b21f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:14.149784 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c3cdc9b1-9ef2-4fb8-aab0-cd0c2942b21f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:14.150218 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c3cdc9b1-9ef2-4fb8-aab0-cd0c2942b21f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:14.284738 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-c3cdc9b1-9ef2-4fb8-aab0-cd0c2942b21f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:14.292391 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-c3cdc9b1-9ef2-4fb8-aab0-cd0c2942b21f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1578 microversion: 2.1 time: 0.157188 Jun 16 19:06:14.292958 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 508/1053] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:14 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:14.673298 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1bed6a78-1148-4ce9-82d1-864ecf29688d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:14.673883 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-1bed6a78-1148-4ce9-82d1-864ecf29688d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:14.680989 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1bed6a78-1148-4ce9-82d1-864ecf29688d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:14.681480 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1bed6a78-1148-4ce9-82d1-864ecf29688d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:14.682246 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1bed6a78-1148-4ce9-82d1-864ecf29688d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:14.682685 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1bed6a78-1148-4ce9-82d1-864ecf29688d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:14.809699 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1bed6a78-1148-4ce9-82d1-864ecf29688d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:14.817158 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-1bed6a78-1148-4ce9-82d1-864ecf29688d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1682 microversion: 2.1 time: 0.147903 Jun 16 19:06:14.817751 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 546/1054] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:14 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:15.310646 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-7a024773-242a-4b4b-bf17-26d98264108b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:15.312050 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-7a024773-242a-4b4b-bf17-26d98264108b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:15.318734 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7a024773-242a-4b4b-bf17-26d98264108b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:15.319248 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7a024773-242a-4b4b-bf17-26d98264108b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:15.319939 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7a024773-242a-4b4b-bf17-26d98264108b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:15.320372 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7a024773-242a-4b4b-bf17-26d98264108b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:15.325302 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:15.653277 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-72af5c1d-177e-47a7-ad46-19cfcb1e7874 req-735b1879-5b57-4f0d-b65e-be755b6ce2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b0e627a-a28a-419d-854b-63e81d67a3f7", "name": "network-vif-deleted", "tag": "66d9152b-c02c-4f61-9fe8-f277bc4c64a1"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:15.653883 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-7a024773-242a-4b4b-bf17-26d98264108b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:15.661706 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-7a024773-242a-4b4b-bf17-26d98264108b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1578 microversion: 2.1 time: 0.355262 Jun 16 19:06:15.662506 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 509/1055] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:15 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1578 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:15.667323 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-72af5c1d-177e-47a7-ad46-19cfcb1e7874 req-735b1879-5b57-4f0d-b65e-be755b6ce2a0 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:15.673510 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-72af5c1d-177e-47a7-ad46-19cfcb1e7874 req-735b1879-5b57-4f0d-b65e-be755b6ce2a0 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:15.673510 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:15.682731 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-72af5c1d-177e-47a7-ad46-19cfcb1e7874 req-735b1879-5b57-4f0d-b65e-be755b6ce2a0 service nova] Creating event network-vif-deleted:66d9152b-c02c-4f61-9fe8-f277bc4c64a1 for instance 5b0e627a-a28a-419d-854b-63e81d67a3f7 on hv-cinder-84617 Jun 16 19:06:15.687606 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-72af5c1d-177e-47a7-ad46-19cfcb1e7874 req-735b1879-5b57-4f0d-b65e-be755b6ce2a0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038077 Jun 16 19:06:15.688195 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 547/1056] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:15.834207 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b490b4bd-993e-44de-bc2b-98087a0efea0 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:15.834943 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b490b4bd-993e-44de-bc2b-98087a0efea0 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:15.840955 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b490b4bd-993e-44de-bc2b-98087a0efea0 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:15.841458 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b490b4bd-993e-44de-bc2b-98087a0efea0 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:15.842372 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b490b4bd-993e-44de-bc2b-98087a0efea0 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:15.842739 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b490b4bd-993e-44de-bc2b-98087a0efea0 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:15.994090 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b490b4bd-993e-44de-bc2b-98087a0efea0 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:16.002519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b490b4bd-993e-44de-bc2b-98087a0efea0 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1682 microversion: 2.1 time: 0.172197 Jun 16 19:06:16.003026 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 510/1057] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:15 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:16.381713 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-2c48c2c8-00fd-452e-85d4-bff405f3684a req-ba5b8eac-11b5-43c3-be27-9bfc2ba56ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a69da73-7a7e-4f27-b52f-1bec2f65f145", "name": "network-vif-deleted", "tag": "dc6d3d2a-8aa4-44da-b96a-930f2a198820"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:16.391064 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-2c48c2c8-00fd-452e-85d4-bff405f3684a req-ba5b8eac-11b5-43c3-be27-9bfc2ba56ea1 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:16.391645 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-2c48c2c8-00fd-452e-85d4-bff405f3684a req-ba5b8eac-11b5-43c3-be27-9bfc2ba56ea1 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:16.403055 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-2c48c2c8-00fd-452e-85d4-bff405f3684a req-ba5b8eac-11b5-43c3-be27-9bfc2ba56ea1 service nova] Creating event network-vif-deleted:dc6d3d2a-8aa4-44da-b96a-930f2a198820 for instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 on hv-cinder-84617 Jun 16 19:06:16.407965 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-2c48c2c8-00fd-452e-85d4-bff405f3684a req-ba5b8eac-11b5-43c3-be27-9bfc2ba56ea1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030706 Jun 16 19:06:16.408543 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 548/1058] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:16.679394 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-34c13a0b-0771-4e7b-b322-8ce42487c68f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:16.680573 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-34c13a0b-0771-4e7b-b322-8ce42487c68f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:16.688070 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-34c13a0b-0771-4e7b-b322-8ce42487c68f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:16.688519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-34c13a0b-0771-4e7b-b322-8ce42487c68f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:16.689499 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-34c13a0b-0771-4e7b-b322-8ce42487c68f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:16.690103 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-34c13a0b-0771-4e7b-b322-8ce42487c68f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:16.724623 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-34c13a0b-0771-4e7b-b322-8ce42487c68f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:16.725069 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-34c13a0b-0771-4e7b-b322-8ce42487c68f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:16.725543 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.objects.instance [None req-34c13a0b-0771-4e7b-b322-8ce42487c68f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lazy-loading 'fault' on Instance uuid 5b0e627a-a28a-419d-854b-63e81d67a3f7 {{(pid=130230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:06:16.767646 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-34c13a0b-0771-4e7b-b322-8ce42487c68f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c0e7e9f9d0f409a8820d8bd8dd239cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc32e3179c534d83b3d4108a38fb9d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:16.775930 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-34c13a0b-0771-4e7b-b322-8ce42487c68f tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 200 len: 1396 microversion: 2.1 time: 0.100348 Jun 16 19:06:16.777256 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 511/1059] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:16 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 1396 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:17.021223 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-7dd768b3-f3ad-4b53-8edd-a3d388941e95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:17.022328 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-7dd768b3-f3ad-4b53-8edd-a3d388941e95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:17.031268 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7dd768b3-f3ad-4b53-8edd-a3d388941e95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:17.031722 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7dd768b3-f3ad-4b53-8edd-a3d388941e95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:17.032568 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7dd768b3-f3ad-4b53-8edd-a3d388941e95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:17.033033 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7dd768b3-f3ad-4b53-8edd-a3d388941e95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:17.065266 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7dd768b3-f3ad-4b53-8edd-a3d388941e95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:17.065734 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-7dd768b3-f3ad-4b53-8edd-a3d388941e95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:17.066272 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-7dd768b3-f3ad-4b53-8edd-a3d388941e95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lazy-loading 'fault' on Instance uuid 8a69da73-7a7e-4f27-b52f-1bec2f65f145 {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:06:17.120300 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-7dd768b3-f3ad-4b53-8edd-a3d388941e95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:17.128282 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-7dd768b3-f3ad-4b53-8edd-a3d388941e95 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 200 len: 1331 microversion: 2.1 time: 0.111719 Jun 16 19:06:17.129854 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 549/1060] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:17 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:17.793983 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c672287d-bf4b-49b7-a632-dfd4ae086c2b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:17.794599 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-c672287d-bf4b-49b7-a632-dfd4ae086c2b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: 5b0e627a-a28a-419d-854b-63e81d67a3f7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:17.801120 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c672287d-bf4b-49b7-a632-dfd4ae086c2b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:17.801601 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c672287d-bf4b-49b7-a632-dfd4ae086c2b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:17.802362 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c672287d-bf4b-49b7-a632-dfd4ae086c2b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:17.802803 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c672287d-bf4b-49b7-a632-dfd4ae086c2b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:17.819255 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-c672287d-bf4b-49b7-a632-dfd4ae086c2b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] HTTP exception thrown: Instance 5b0e627a-a28a-419d-854b-63e81d67a3f7 could not be found. Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c672287d-bf4b-49b7-a632-dfd4ae086c2b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Request method failure captured: Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 HTTP/1.1 Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq30361t7E8doIA6nwYkO3vD4KCZTaRR9Q0WWFAXPQeVo3ZUvcXZScN8v32Zwpv-WHAlG6FZv-LYGnOD1MjwQttBV8Ubwx0B0WINdW_g8UesKwVW5nRA3cDgte6vHx0prOEICzTT0JXhVRtWoQWQ6wb8PoQyXRrN5cbDOSfrhmmNUgLc Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: fc32e3179c534d83b3d4108a38fb9d19 Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-TestVolumeBootPattern-1915969095 Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:06:17.820982 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:06:17.822519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fc32e3179c534d83b3d4108a38fb9d19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_fc32e3179c534d83b3d4108a38fb9d19", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fc32e3179c534d83b3d4108a38fb9d19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/fc32e3179c534d83b3d4108a38fb9d19"}]}] Jun 16 19:06:17.822519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-TestVolumeBootPattern-1915969095 Jun 16 19:06:17.822519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: fc32e3179c534d83b3d4108a38fb9d19 Jun 16 19:06:17.822519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-TestVolumeBootPattern-1915969095 Jun 16 19:06:17.822519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-TestVolumeBootPattern-1915969095-project Jun 16 19:06:17.822519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:06:17.822519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:06:17.822519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 1c0e7e9f9d0f409a8820d8bd8dd239cf Jun 16 19:06:17.822519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-TestVolumeBootPattern-1915969095-project Jun 16 19:06:17.822519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:06:17.822519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance 5b0e627a-a28a-419d-854b-63e81d67a3f7 could not be found. Jun 16 19:06:17.822519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': '5b0e627a-a28a-419d-854b-63e81d67a3f7'} Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b0e627a-a28a-419d-854b-63e81d67a3f7 could not be found. Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:06:17.823265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b0e627a-a28a-419d-854b-63e81d67a3f7 could not be found. Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b0e627a-a28a-419d-854b-63e81d67a3f7 could not be found. Jun 16 19:06:17.824713 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:06:17.826097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c672287d-bf4b-49b7-a632-dfd4ae086c2b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Returning 404 to user: Instance 5b0e627a-a28a-419d-854b-63e81d67a3f7 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:06:17.826097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-c672287d-bf4b-49b7-a632-dfd4ae086c2b tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7" status: 404 len: 111 microversion: 2.1 time: 0.033137 Jun 16 19:06:17.826097 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 512/1061] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:17 2022] GET /compute/v2.1/servers/5b0e627a-a28a-419d-854b-63e81d67a3f7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:06:18.146534 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8004e4cb-616f-4329-b0fc-638b90cd8d55 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:18.147284 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8004e4cb-616f-4329-b0fc-638b90cd8d55 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:18.154098 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8004e4cb-616f-4329-b0fc-638b90cd8d55 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:18.154700 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8004e4cb-616f-4329-b0fc-638b90cd8d55 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:18.155572 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8004e4cb-616f-4329-b0fc-638b90cd8d55 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:18.156047 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8004e4cb-616f-4329-b0fc-638b90cd8d55 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:18.169600 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-8004e4cb-616f-4329-b0fc-638b90cd8d55 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] HTTP exception thrown: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8004e4cb-616f-4329-b0fc-638b90cd8d55 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Request method failure captured: Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 HTTP/1.1 Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq36otl9Z_9Uiu0W2mg3FY9q2qgCS_Cc1PxlbzIDrBO8P3LU1ECIrM7T29od52OXBUcCnSlAwdyhzA3OZjSK1OKGpcp24QmnPZEy0Wk9nU6RvttgAU-rPxhRN2BqQnwtSWlyl3NKiQytbydUY3h7cF5WFM7v828GjpSevZojX3s7BtiE Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:06:18.171254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:06:18.172917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cfa6530fe6dd49d88f41c57406f4cbb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cfa6530fe6dd49d88f41c57406f4cbb6"}]}] Jun 16 19:06:18.172917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:06:18.172917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:06:18.172917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:06:18.172917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:06:18.172917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:06:18.172917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:06:18.172917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 06722257713746f697d1f609c3956e05 Jun 16 19:06:18.172917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:06:18.172917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:06:18.172917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. Jun 16 19:06:18.172917 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': '8a69da73-7a7e-4f27-b52f-1bec2f65f145'} Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:06:18.176733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. Jun 16 19:06:18.178235 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:18.179583 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8004e4cb-616f-4329-b0fc-638b90cd8d55 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Returning 404 to user: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:06:18.179583 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8004e4cb-616f-4329-b0fc-638b90cd8d55 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 404 len: 111 microversion: 2.1 time: 0.030101 Jun 16 19:06:18.179583 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 550/1062] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:18 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:06:18.182227 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-7eea375b-0c9c-4550-ab26-786a32dd9cb3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '.version_select at 0x7f2014077040>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:18.293429 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-7eea375b-0c9c-4550-ab26-786a32dd9cb3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450587355" status: 202 len: 0 microversion: 2.1 time: 0.115532 Jun 16 19:06:18.294018 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 513/1063] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jun 16 19:06:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450587355 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:06:18.323267 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5df7c79a-b8ad-4222-a588-06e24a766b53 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:18.323833 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-5df7c79a-b8ad-4222-a588-06e24a766b53 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:18.333591 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5df7c79a-b8ad-4222-a588-06e24a766b53 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:18.334198 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5df7c79a-b8ad-4222-a588-06e24a766b53 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:18.335005 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5df7c79a-b8ad-4222-a588-06e24a766b53 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:18.335477 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-5df7c79a-b8ad-4222-a588-06e24a766b53 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:18.355073 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-5df7c79a-b8ad-4222-a588-06e24a766b53 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] HTTP exception thrown: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5df7c79a-b8ad-4222-a588-06e24a766b53 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Request method failure captured: Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: DELETE /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b HTTP/1.1 Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq30361t7E8doIA6nwYkO3vD4KCZTaRR9Q0WWFAXPQeVo3ZUvcXZScN8v32Zwpv-WHAlG6FZv-LYGnOD1MjwQttBV8Ubwx0B0WINdW_g8UesKwVW5nRA3cDgte6vHx0prOEICzTT0JXhVRtWoQWQ6wb8PoQyXRrN5cbDOSfrhmmNUgLc Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: fc32e3179c534d83b3d4108a38fb9d19 Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-TestVolumeBootPattern-1915969095 Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:06:18.357452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:06:18.359120 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fc32e3179c534d83b3d4108a38fb9d19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_fc32e3179c534d83b3d4108a38fb9d19", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fc32e3179c534d83b3d4108a38fb9d19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/fc32e3179c534d83b3d4108a38fb9d19"}]}] Jun 16 19:06:18.359120 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-TestVolumeBootPattern-1915969095 Jun 16 19:06:18.359120 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: fc32e3179c534d83b3d4108a38fb9d19 Jun 16 19:06:18.359120 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-TestVolumeBootPattern-1915969095 Jun 16 19:06:18.359120 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-TestVolumeBootPattern-1915969095-project Jun 16 19:06:18.359120 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:06:18.359120 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:06:18.359120 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 1c0e7e9f9d0f409a8820d8bd8dd239cf Jun 16 19:06:18.359120 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-TestVolumeBootPattern-1915969095-project Jun 16 19:06:18.359120 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:06:18.359120 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. Jun 16 19:06:18.359120 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': 'd73e2d8a-72b0-45bc-9693-eecf5c504b5b'} Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:06:18.359928 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. Jun 16 19:06:18.361292 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:06:18.362722 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-5df7c79a-b8ad-4222-a588-06e24a766b53 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Returning 404 to user: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:06:18.362722 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-5df7c79a-b8ad-4222-a588-06e24a766b53 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "DELETE /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 404 len: 111 microversion: 2.1 time: 0.040466 Jun 16 19:06:18.362722 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 551/1064] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:06:18 2022] DELETE /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:06:18.369937 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c509e1b0-7775-4092-a129-cbf67dc34376 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:18.371931 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-c509e1b0-7775-4092-a129-cbf67dc34376 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] [instance: d73e2d8a-72b0-45bc-9693-eecf5c504b5b] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:18.378188 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c509e1b0-7775-4092-a129-cbf67dc34376 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:18.378694 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c509e1b0-7775-4092-a129-cbf67dc34376 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:18.379530 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c509e1b0-7775-4092-a129-cbf67dc34376 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:18.379975 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-c509e1b0-7775-4092-a129-cbf67dc34376 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:18.394757 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-c509e1b0-7775-4092-a129-cbf67dc34376 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] HTTP exception thrown: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c509e1b0-7775-4092-a129-cbf67dc34376 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Request method failure captured: Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b HTTP/1.1 Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq30361t7E8doIA6nwYkO3vD4KCZTaRR9Q0WWFAXPQeVo3ZUvcXZScN8v32Zwpv-WHAlG6FZv-LYGnOD1MjwQttBV8Ubwx0B0WINdW_g8UesKwVW5nRA3cDgte6vHx0prOEICzTT0JXhVRtWoQWQ6wb8PoQyXRrN5cbDOSfrhmmNUgLc Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: fc32e3179c534d83b3d4108a38fb9d19 Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-TestVolumeBootPattern-1915969095 Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:06:18.396320 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:06:18.397863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fc32e3179c534d83b3d4108a38fb9d19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_fc32e3179c534d83b3d4108a38fb9d19", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/fc32e3179c534d83b3d4108a38fb9d19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/fc32e3179c534d83b3d4108a38fb9d19"}]}] Jun 16 19:06:18.397863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-TestVolumeBootPattern-1915969095 Jun 16 19:06:18.397863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: fc32e3179c534d83b3d4108a38fb9d19 Jun 16 19:06:18.397863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-TestVolumeBootPattern-1915969095 Jun 16 19:06:18.397863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-TestVolumeBootPattern-1915969095-project Jun 16 19:06:18.397863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:06:18.397863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:06:18.397863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 1c0e7e9f9d0f409a8820d8bd8dd239cf Jun 16 19:06:18.397863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-TestVolumeBootPattern-1915969095-project Jun 16 19:06:18.397863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:06:18.397863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. Jun 16 19:06:18.397863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': 'd73e2d8a-72b0-45bc-9693-eecf5c504b5b'} Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:06:18.398771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. Jun 16 19:06:18.400167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:06:18.401438 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-c509e1b0-7775-4092-a129-cbf67dc34376 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Returning 404 to user: Instance d73e2d8a-72b0-45bc-9693-eecf5c504b5b could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:06:18.401438 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-c509e1b0-7775-4092-a129-cbf67dc34376 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b" status: 404 len: 111 microversion: 2.1 time: 0.032516 Jun 16 19:06:18.401438 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 514/1065] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:18 2022] GET /compute/v2.1/servers/d73e2d8a-72b0-45bc-9693-eecf5c504b5b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:06:19.120049 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-dc8b2f53-2644-49bf-8a94-5c2847b2374f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Action: 'create', calling method: .version_select at 0x7f20140c8e50>, body: {"keypair": {"name": "tempest-keypair-1206265946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTEX6qo8dc5N81bKf4ptA7zOmjaOLfWGB2PYD29wTzoCBUI8L5wX1Z9fBcA/EnnSO/So+yhoIQz2e/dP8R7ELPc0yrL5EYwHerAW91vZk7xTXnqxIK0TCbrXWcjAr1UdQ=="}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:19.134110 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-dc8b2f53-2644-49bf-8a94-5c2847b2374f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'key_pairs'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:06:19.137859 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-dc8b2f53-2644-49bf-8a94-5c2847b2374f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for user 06722257713746f697d1f609c3956e05 and project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'key_pairs'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:06:19.230686 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-dc8b2f53-2644-49bf-8a94-5c2847b2374f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114434 Jun 16 19:06:19.231326 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 552/1066] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jun 16 19:06:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:20.027749 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ebb705ab-a602-4e2e-8177-132c65364319 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] Calling method '.version_select at 0x7f2014077820>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:20.122004 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ebb705ab-a602-4e2e-8177-132c65364319 tempest-TestVolumeBootPattern-1915969095 tempest-TestVolumeBootPattern-1915969095-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1310473773" status: 202 len: 0 microversion: 2.1 time: 0.097921 Jun 16 19:06:20.122871 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 515/1067] 10.222.0.81 () {58 vars in 1262 bytes} [Thu Jun 16 19:06:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1310473773 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:06:21.443630 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2046996681", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f5b1bf4-16e2-474a-b72c-6a89096e68f2"}], "security_groups": [{"name": "tempest-securitygroup--918085758"}], "key_name": "tempest-keypair-1206265946", "user_data": "}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:21.619137 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.network.neutron [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] validate_networks() for [('9f5b1bf4-16e2-474a-b72c-6a89096e68f2', None, None, None, None, None)] {{(pid=130229) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:06:22.294752 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Flavor limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:06:22.295169 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Image limits 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:06:22.295658 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Flavor pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:06:22.296155 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Image pref 0:0:0 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:06:22.296572 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.virt.hardware [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130229) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:06:22.305439 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:22.305879 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:22.306927 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:22.307594 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:22.325638 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:06:22.329975 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for user 06722257713746f697d1f609c3956e05 and project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'cores', 'ram', 'instances'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:06:22.342672 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Going to run 1 instances... {{(pid=130229) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:06:22.345257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130229) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:06:22.504493 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-59e57e04-a15e-4317-864d-56463b61a527 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.065585 Jun 16 19:06:22.510200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 553/1068] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 19:06:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:06:22.516648 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-502d3d8c-6e8b-42a1-a18e-c375c1b8ed33 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:22.517592 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-502d3d8c-6e8b-42a1-a18e-c375c1b8ed33 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:22.578568 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-502d3d8c-6e8b-42a1-a18e-c375c1b8ed33 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:22.586163 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-502d3d8c-6e8b-42a1-a18e-c375c1b8ed33 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 200 len: 1242 microversion: 2.1 time: 0.074492 Jun 16 19:06:22.595589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 516/1069] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:22 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:23.610214 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a3b064f5-fdf0-4831-9ece-54a4783aa651 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:23.612818 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a3b064f5-fdf0-4831-9ece-54a4783aa651 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:23.625611 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a3b064f5-fdf0-4831-9ece-54a4783aa651 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:23.626221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a3b064f5-fdf0-4831-9ece-54a4783aa651 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:23.627255 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a3b064f5-fdf0-4831-9ece-54a4783aa651 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:23.627757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a3b064f5-fdf0-4831-9ece-54a4783aa651 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:23.727061 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a3b064f5-fdf0-4831-9ece-54a4783aa651 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:23.739173 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a3b064f5-fdf0-4831-9ece-54a4783aa651 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 200 len: 1246 microversion: 2.1 time: 0.140024 Jun 16 19:06:23.745994 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 554/1070] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:23 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 1246 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:24.759021 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9c5fe231-1040-4200-be23-5fbe00d732de tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:24.760263 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9c5fe231-1040-4200-be23-5fbe00d732de tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:24.769112 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c5fe231-1040-4200-be23-5fbe00d732de tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:24.769589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c5fe231-1040-4200-be23-5fbe00d732de tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:24.771012 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c5fe231-1040-4200-be23-5fbe00d732de tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:24.771647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c5fe231-1040-4200-be23-5fbe00d732de tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:24.847945 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9c5fe231-1040-4200-be23-5fbe00d732de tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:24.857849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9c5fe231-1040-4200-be23-5fbe00d732de tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 200 len: 1302 microversion: 2.1 time: 0.103719 Jun 16 19:06:24.858694 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 517/1071] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:24 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 1302 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:25.877084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b7fc11f4-2901-453a-ab51-d05dd61dbc9a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:25.877084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b7fc11f4-2901-453a-ab51-d05dd61dbc9a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:25.883415 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7fc11f4-2901-453a-ab51-d05dd61dbc9a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:25.884522 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7fc11f4-2901-453a-ab51-d05dd61dbc9a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:25.885430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7fc11f4-2901-453a-ab51-d05dd61dbc9a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:25.886000 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7fc11f4-2901-453a-ab51-d05dd61dbc9a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:26.501002 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b7fc11f4-2901-453a-ab51-d05dd61dbc9a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:26.508345 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b7fc11f4-2901-453a-ab51-d05dd61dbc9a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 200 len: 1367 microversion: 2.1 time: 0.637195 Jun 16 19:06:26.509499 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 555/1072] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:25 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 1367 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:27.280187 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-b357a369-ae96-4ad2-9d8e-00b21e33ce3b req-ba92ba83-1ab1-46dd-a02e-4ad390079516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da4c1366-5e97-4a64-9307-dd4ba3f10ff3", "tag": "0086278e-f064-4820-90a4-232684b7bc52"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:27.289969 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-b357a369-ae96-4ad2-9d8e-00b21e33ce3b req-ba92ba83-1ab1-46dd-a02e-4ad390079516 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:27.295798 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-b357a369-ae96-4ad2-9d8e-00b21e33ce3b req-ba92ba83-1ab1-46dd-a02e-4ad390079516 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:27.302526 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-b357a369-ae96-4ad2-9d8e-00b21e33ce3b req-ba92ba83-1ab1-46dd-a02e-4ad390079516 service nova] Creating event network-changed:0086278e-f064-4820-90a4-232684b7bc52 for instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 on hv-cinder-84617 Jun 16 19:06:27.308422 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-b357a369-ae96-4ad2-9d8e-00b21e33ce3b req-ba92ba83-1ab1-46dd-a02e-4ad390079516 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031869 Jun 16 19:06:27.309053 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 518/1073] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:27.526654 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e8882b6e-f9e5-4808-bde8-88c6914c52ca tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:27.527355 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e8882b6e-f9e5-4808-bde8-88c6914c52ca tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:27.534284 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e8882b6e-f9e5-4808-bde8-88c6914c52ca tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:27.534740 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e8882b6e-f9e5-4808-bde8-88c6914c52ca tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:27.535514 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e8882b6e-f9e5-4808-bde8-88c6914c52ca tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:27.535947 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e8882b6e-f9e5-4808-bde8-88c6914c52ca tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:27.717822 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-e8882b6e-f9e5-4808-bde8-88c6914c52ca tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:27.725452 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e8882b6e-f9e5-4808-bde8-88c6914c52ca tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 200 len: 1367 microversion: 2.1 time: 0.203186 Jun 16 19:06:27.725957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 556/1074] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:27 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:28.745869 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6287d54e-332c-4db5-9b4b-1ef42990e875 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:28.745869 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6287d54e-332c-4db5-9b4b-1ef42990e875 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:28.751084 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6287d54e-332c-4db5-9b4b-1ef42990e875 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:28.751439 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6287d54e-332c-4db5-9b4b-1ef42990e875 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:28.752216 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6287d54e-332c-4db5-9b4b-1ef42990e875 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:28.752679 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6287d54e-332c-4db5-9b4b-1ef42990e875 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:28.884193 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6287d54e-332c-4db5-9b4b-1ef42990e875 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:28.892687 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6287d54e-332c-4db5-9b4b-1ef42990e875 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 200 len: 1367 microversion: 2.1 time: 0.153924 Jun 16 19:06:28.893089 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 519/1075] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:28 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:06:29.909405 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-418a0f35-858a-4440-a352-712b779c9409 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:29.910007 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-418a0f35-858a-4440-a352-712b779c9409 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:29.916672 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-418a0f35-858a-4440-a352-712b779c9409 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:29.926563 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-418a0f35-858a-4440-a352-712b779c9409 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:29.926563 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-418a0f35-858a-4440-a352-712b779c9409 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:29.926563 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-418a0f35-858a-4440-a352-712b779c9409 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:30.053157 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-418a0f35-858a-4440-a352-712b779c9409 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:30.060745 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-418a0f35-858a-4440-a352-712b779c9409 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 200 len: 1367 microversion: 2.1 time: 0.155294 Jun 16 19:06:30.061659 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 557/1076] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:29 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:31.077071 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-462a54e3-9a26-42cb-beb0-00b2a38240b4 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:31.077721 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-462a54e3-9a26-42cb-beb0-00b2a38240b4 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:31.084502 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-462a54e3-9a26-42cb-beb0-00b2a38240b4 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:31.084956 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-462a54e3-9a26-42cb-beb0-00b2a38240b4 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:31.085777 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-462a54e3-9a26-42cb-beb0-00b2a38240b4 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:31.086217 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-462a54e3-9a26-42cb-beb0-00b2a38240b4 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:31.220326 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-462a54e3-9a26-42cb-beb0-00b2a38240b4 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:31.227831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-462a54e3-9a26-42cb-beb0-00b2a38240b4 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 200 len: 1367 microversion: 2.1 time: 0.154680 Jun 16 19:06:31.228394 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 520/1077] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:31 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:32.244463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-048a5a83-9545-478d-b8cc-71edfcdb6337 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:32.245074 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-048a5a83-9545-478d-b8cc-71edfcdb6337 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:32.251867 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-048a5a83-9545-478d-b8cc-71edfcdb6337 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:32.252315 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-048a5a83-9545-478d-b8cc-71edfcdb6337 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:32.253075 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-048a5a83-9545-478d-b8cc-71edfcdb6337 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:32.253542 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-048a5a83-9545-478d-b8cc-71edfcdb6337 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:32.316593 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:32.337430 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=10 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:32.382544 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-048a5a83-9545-478d-b8cc-71edfcdb6337 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:32.390562 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-048a5a83-9545-478d-b8cc-71edfcdb6337 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 200 len: 1367 microversion: 2.1 time: 0.150022 Jun 16 19:06:32.391120 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 558/1078] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:32 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:32.921791 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-0f6c726e-2fb2-429f-9243-0282d2d7ae91 req-c9378fc9-ad94-4786-a524-1c35872b4070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4c1366-5e97-4a64-9307-dd4ba3f10ff3", "name": "network-vif-plugged", "status": "completed", "tag": "0086278e-f064-4820-90a4-232684b7bc52"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:32.925954 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:32.931255 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-0f6c726e-2fb2-429f-9243-0282d2d7ae91 req-c9378fc9-ad94-4786-a524-1c35872b4070 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:32.931702 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-0f6c726e-2fb2-429f-9243-0282d2d7ae91 req-c9378fc9-ad94-4786-a524-1c35872b4070 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:32.942865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-0f6c726e-2fb2-429f-9243-0282d2d7ae91 req-c9378fc9-ad94-4786-a524-1c35872b4070 service nova] Creating event network-vif-plugged:0086278e-f064-4820-90a4-232684b7bc52 for instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 on hv-cinder-84617 Jun 16 19:06:32.947745 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-0f6c726e-2fb2-429f-9243-0282d2d7ae91 req-c9378fc9-ad94-4786-a524-1c35872b4070 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029690 Jun 16 19:06:32.948432 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 521/1079] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:33.408199 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f48c9e92-706c-4f87-ad9a-84d54de22949 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:33.408836 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f48c9e92-706c-4f87-ad9a-84d54de22949 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:33.411104 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:33.415918 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f48c9e92-706c-4f87-ad9a-84d54de22949 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:33.416943 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f48c9e92-706c-4f87-ad9a-84d54de22949 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:33.417720 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f48c9e92-706c-4f87-ad9a-84d54de22949 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:33.418150 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f48c9e92-706c-4f87-ad9a-84d54de22949 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:33.545018 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f48c9e92-706c-4f87-ad9a-84d54de22949 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:33.552303 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f48c9e92-706c-4f87-ad9a-84d54de22949 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 200 len: 1367 microversion: 2.1 time: 0.148451 Jun 16 19:06:33.552866 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 559/1080] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:33 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:34.569214 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9f105a9d-d485-45f4-8f03-d8355f30f060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:34.569935 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9f105a9d-d485-45f4-8f03-d8355f30f060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:34.572138 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:34.577771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9f105a9d-d485-45f4-8f03-d8355f30f060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:34.578213 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9f105a9d-d485-45f4-8f03-d8355f30f060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:34.578966 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9f105a9d-d485-45f4-8f03-d8355f30f060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:34.579399 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9f105a9d-d485-45f4-8f03-d8355f30f060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:34.712690 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9f105a9d-d485-45f4-8f03-d8355f30f060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:34.720331 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9f105a9d-d485-45f4-8f03-d8355f30f060 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 200 len: 1367 microversion: 2.1 time: 0.155844 Jun 16 19:06:34.720894 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 522/1081] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:34 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:35.737177 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3c60b590-e567-4379-bec0-d532de061149 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:35.737752 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3c60b590-e567-4379-bec0-d532de061149 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:35.744668 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3c60b590-e567-4379-bec0-d532de061149 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:35.745115 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3c60b590-e567-4379-bec0-d532de061149 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:35.745916 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3c60b590-e567-4379-bec0-d532de061149 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:35.746381 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3c60b590-e567-4379-bec0-d532de061149 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:35.872424 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3c60b590-e567-4379-bec0-d532de061149 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:35.880128 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3c60b590-e567-4379-bec0-d532de061149 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 200 len: 1557 microversion: 2.1 time: 0.146919 Jun 16 19:06:35.880713 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 560/1082] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:35 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 1557 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:35.896644 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a59c0360-0dae-490c-a081-b3f1c6358ea5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:35.897165 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a59c0360-0dae-490c-a081-b3f1c6358ea5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:35.904222 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a59c0360-0dae-490c-a081-b3f1c6358ea5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:35.904674 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a59c0360-0dae-490c-a081-b3f1c6358ea5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:35.905484 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a59c0360-0dae-490c-a081-b3f1c6358ea5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:35.905926 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a59c0360-0dae-490c-a081-b3f1c6358ea5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:35.979961 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a59c0360-0dae-490c-a081-b3f1c6358ea5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087184 Jun 16 19:06:35.980551 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 523/1083] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jun 16 19:06:35 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:37.144976 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-b4098b6e-938b-47ff-b9b1-dec666d714ed req-19d03b98-4a9d-4b5e-9f7d-3693bd20b95d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da4c1366-5e97-4a64-9307-dd4ba3f10ff3", "tag": "0086278e-f064-4820-90a4-232684b7bc52"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:37.153092 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-b4098b6e-938b-47ff-b9b1-dec666d714ed req-19d03b98-4a9d-4b5e-9f7d-3693bd20b95d service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:37.153566 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-b4098b6e-938b-47ff-b9b1-dec666d714ed req-19d03b98-4a9d-4b5e-9f7d-3693bd20b95d service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:37.164521 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-b4098b6e-938b-47ff-b9b1-dec666d714ed req-19d03b98-4a9d-4b5e-9f7d-3693bd20b95d service nova] Creating event network-changed:0086278e-f064-4820-90a4-232684b7bc52 for instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 on hv-cinder-84617 Jun 16 19:06:37.170125 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-b4098b6e-938b-47ff-b9b1-dec666d714ed req-19d03b98-4a9d-4b5e-9f7d-3693bd20b95d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207320 Jun 16 19:06:37.170718 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 561/1084] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:10.728776 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=3 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:10.729508 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=54 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:10.733459 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-86fdf06e-8b18-46a2-8ad0-a1f82a036b97 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:10.734046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-86fdf06e-8b18-46a2-8ad0-a1f82a036b97 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:10.739830 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-86fdf06e-8b18-46a2-8ad0-a1f82a036b97 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:10.741623 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-86fdf06e-8b18-46a2-8ad0-a1f82a036b97 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:10.741623 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-86fdf06e-8b18-46a2-8ad0-a1f82a036b97 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:10.741623 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-86fdf06e-8b18-46a2-8ad0-a1f82a036b97 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:10.765538 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-86fdf06e-8b18-46a2-8ad0-a1f82a036b97 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3/ips" status: 200 len: 150 microversion: 2.1 time: 0.038161 Jun 16 19:07:10.766102 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 524/1085] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jun 16 19:07:10 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:12.440714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=5 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:12.441480 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=60 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:12.445644 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-e3a3fe9e-3c60-404b-b387-6e02c6a39e39 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81267ec1-06ec-425f-b5c6-07f598c9e9d2"}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:12.446765 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-e3a3fe9e-3c60-404b-b387-6e02c6a39e39 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:12.452654 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e3a3fe9e-3c60-404b-b387-6e02c6a39e39 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:12.455159 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e3a3fe9e-3c60-404b-b387-6e02c6a39e39 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:12.455159 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e3a3fe9e-3c60-404b-b387-6e02c6a39e39 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:12.455159 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-e3a3fe9e-3c60-404b-b387-6e02c6a39e39 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:13.223493 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-e3a3fe9e-3c60-404b-b387-6e02c6a39e39 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "POST /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784176 Jun 16 19:07:13.224125 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 562/1086] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jun 16 19:07:12 2022] POST /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:20.701432 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9b2fbce1-d01d-418f-9b5f-f52d18f144a1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81267ec1-06ec-425f-b5c6-07f598c9e9d2"}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:20.702996 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9b2fbce1-d01d-418f-9b5f-f52d18f144a1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:20.710136 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9b2fbce1-d01d-418f-9b5f-f52d18f144a1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:20.710581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9b2fbce1-d01d-418f-9b5f-f52d18f144a1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:20.711353 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9b2fbce1-d01d-418f-9b5f-f52d18f144a1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:20.711790 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9b2fbce1-d01d-418f-9b5f-f52d18f144a1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:20.789992 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-9b2fbce1-d01d-418f-9b5f-f52d18f144a1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] HTTP exception thrown: Invalid volume: volume 81267ec1-06ec-425f-b5c6-07f598c9e9d2 is already attached to instances: da4c1366-5e97-4a64-9307-dd4ba3f10ff3 Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9b2fbce1-d01d-418f-9b5f-f52d18f144a1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Request method failure captured: Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: POST /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3/os-volume_attachments HTTP/1.1 Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 74 Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq36otl9Z_9Uiu0W2mg3FY9q2qgCS_Cc1PxlbzIDrBO8P3LU1ECIrM7T29od52OXBUcCnSlAwdyhzA3OZjSK1OKGpcp24QmnPZEy0Wk9nU6RvttgAU-rPxhRN2BqQnwtSWlyl3NKiQytbydUY3h7cF5WFM7v828GjpSevZojX3s7BtiE Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:07:20.791729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:07:20.793440 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cfa6530fe6dd49d88f41c57406f4cbb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cfa6530fe6dd49d88f41c57406f4cbb6"}]}] Jun 16 19:07:20.793440 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:07:20.793440 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:07:20.793440 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:07:20.793440 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:07:20.793440 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:07:20.793440 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:07:20.793440 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 06722257713746f697d1f609c3956e05 Jun 16 19:07:20.793440 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:07:20.793440 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Jun 16 19:07:20.793440 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {"volumeAttachment": {"volumeId": "81267ec1-06ec-425f-b5c6-07f598c9e9d2"}} Jun 16 19:07:20.793440 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Invalid volume: volume 81267ec1-06ec-425f-b5c6-07f598c9e9d2 is already attached to instances: da4c1366-5e97-4a64-9307-dd4ba3f10ff3 Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'server_id': 'da4c1366-5e97-4a64-9307-dd4ba3f10ff3', 'body': {'volumeAttachment': {'volumeId': '81267ec1-06ec-425f-b5c6-07f598c9e9d2'}}} Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 81267ec1-06ec-425f-b5c6-07f598c9e9d2 is already attached to instances: da4c1366-5e97-4a64-9307-dd4ba3f10ff3 Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:07:20.794472 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 81267ec1-06ec-425f-b5c6-07f598c9e9d2 is already attached to instances: da4c1366-5e97-4a64-9307-dd4ba3f10ff3 Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:20.795775 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:20.797415 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:20.797415 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:20.797415 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:20.797415 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 81267ec1-06ec-425f-b5c6-07f598c9e9d2 is already attached to instances: da4c1366-5e97-4a64-9307-dd4ba3f10ff3 Jun 16 19:07:20.797415 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:07:20.797415 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9b2fbce1-d01d-418f-9b5f-f52d18f144a1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Returning 400 to user: Invalid volume: volume 81267ec1-06ec-425f-b5c6-07f598c9e9d2 is already attached to instances: da4c1366-5e97-4a64-9307-dd4ba3f10ff3 {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:20.797415 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9b2fbce1-d01d-418f-9b5f-f52d18f144a1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "POST /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096168 Jun 16 19:07:20.797415 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 525/1087] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jun 16 19:07:20 2022] POST /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:07:20.860130 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-797a9977-a45d-4cd6-b83b-69ac1a1859ab tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:20.860709 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-797a9977-a45d-4cd6-b83b-69ac1a1859ab tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:20.867842 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-797a9977-a45d-4cd6-b83b-69ac1a1859ab tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:20.868296 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-797a9977-a45d-4cd6-b83b-69ac1a1859ab tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:20.869113 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-797a9977-a45d-4cd6-b83b-69ac1a1859ab tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:20.869535 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-797a9977-a45d-4cd6-b83b-69ac1a1859ab tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:20.950771 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-797a9977-a45d-4cd6-b83b-69ac1a1859ab tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lazy-loading 'services' on Instance uuid da4c1366-5e97-4a64-9307-dd4ba3f10ff3 {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:07:21.190500 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-797a9977-a45d-4cd6-b83b-69ac1a1859ab tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "DELETE /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3/os-volume_attachments/81267ec1-06ec-425f-b5c6-07f598c9e9d2" status: 202 len: 0 microversion: 2.1 time: 0.334811 Jun 16 19:07:21.190983 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 563/1088] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jun 16 19:07:20 2022] DELETE /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3/os-volume_attachments/81267ec1-06ec-425f-b5c6-07f598c9e9d2 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:07:21.199547 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-69984353-be81-4572-94c0-5dbcfea506f4 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:21.200484 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-69984353-be81-4572-94c0-5dbcfea506f4 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:21.208045 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-69984353-be81-4572-94c0-5dbcfea506f4 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:21.208496 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-69984353-be81-4572-94c0-5dbcfea506f4 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:21.209301 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-69984353-be81-4572-94c0-5dbcfea506f4 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:21.209742 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-69984353-be81-4572-94c0-5dbcfea506f4 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:21.240179 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-69984353-be81-4572-94c0-5dbcfea506f4 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044587 Jun 16 19:07:21.240832 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 526/1089] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:07:21 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:22.253285 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0cb57beb-3606-4a8f-9785-fcb8074fa45a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:22.254363 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0cb57beb-3606-4a8f-9785-fcb8074fa45a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:22.260535 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0cb57beb-3606-4a8f-9785-fcb8074fa45a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:22.260980 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0cb57beb-3606-4a8f-9785-fcb8074fa45a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:22.261767 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0cb57beb-3606-4a8f-9785-fcb8074fa45a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:22.262202 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0cb57beb-3606-4a8f-9785-fcb8074fa45a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:22.292104 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0cb57beb-3606-4a8f-9785-fcb8074fa45a tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043588 Jun 16 19:07:22.292675 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 564/1090] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:07:22 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:07:22.349277 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f27567b1-888c-4a52-a931-56a74b3f5b62 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:22.349826 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f27567b1-888c-4a52-a931-56a74b3f5b62 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:22.356138 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f27567b1-888c-4a52-a931-56a74b3f5b62 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:22.358544 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f27567b1-888c-4a52-a931-56a74b3f5b62 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:22.358544 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f27567b1-888c-4a52-a931-56a74b3f5b62 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:22.358544 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f27567b1-888c-4a52-a931-56a74b3f5b62 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:22.383106 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f27567b1-888c-4a52-a931-56a74b3f5b62 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Going to try to terminate instance {{(pid=130230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:07:22.790980 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f27567b1-888c-4a52-a931-56a74b3f5b62 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "DELETE /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 204 len: 0 microversion: 2.1 time: 0.445389 Jun 16 19:07:22.791556 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 527/1091] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:07:22 2022] DELETE /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:07:22.800093 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a5a279c6-a497-4e9e-a8e1-458d82c191cc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:22.800704 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a5a279c6-a497-4e9e-a8e1-458d82c191cc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:22.806819 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a5a279c6-a497-4e9e-a8e1-458d82c191cc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:22.807264 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a5a279c6-a497-4e9e-a8e1-458d82c191cc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:22.808018 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a5a279c6-a497-4e9e-a8e1-458d82c191cc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:22.808455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a5a279c6-a497-4e9e-a8e1-458d82c191cc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:22.951568 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-a5a279c6-a497-4e9e-a8e1-458d82c191cc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:22.959095 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a5a279c6-a497-4e9e-a8e1-458d82c191cc tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 200 len: 1682 microversion: 2.1 time: 0.163353 Jun 16 19:07:22.959655 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 565/1092] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:22 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:23.976785 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1e6ba1c7-535c-47af-9e9d-ca78b7350a14 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:23.977555 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1e6ba1c7-535c-47af-9e9d-ca78b7350a14 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:23.984031 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1e6ba1c7-535c-47af-9e9d-ca78b7350a14 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:23.984489 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1e6ba1c7-535c-47af-9e9d-ca78b7350a14 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:23.985272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1e6ba1c7-535c-47af-9e9d-ca78b7350a14 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:23.985716 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1e6ba1c7-535c-47af-9e9d-ca78b7350a14 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:24.419958 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1e6ba1c7-535c-47af-9e9d-ca78b7350a14 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:24.427649 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1e6ba1c7-535c-47af-9e9d-ca78b7350a14 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 200 len: 1682 microversion: 2.1 time: 0.455142 Jun 16 19:07:24.428216 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 528/1093] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:23 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 1682 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:25.227974 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-96bea9cf-8b0e-4617-8662-071e27b88f23 req-ae6aac7b-86a3-43f4-a59d-ea2dd8a6ac8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4c1366-5e97-4a64-9307-dd4ba3f10ff3", "name": "network-vif-deleted", "tag": "0086278e-f064-4820-90a4-232684b7bc52"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:25.237415 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-96bea9cf-8b0e-4617-8662-071e27b88f23 req-ae6aac7b-86a3-43f4-a59d-ea2dd8a6ac8e service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:25.238101 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-96bea9cf-8b0e-4617-8662-071e27b88f23 req-ae6aac7b-86a3-43f4-a59d-ea2dd8a6ac8e service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:25.250712 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-96bea9cf-8b0e-4617-8662-071e27b88f23 req-ae6aac7b-86a3-43f4-a59d-ea2dd8a6ac8e service nova] Creating event network-vif-deleted:0086278e-f064-4820-90a4-232684b7bc52 for instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 on hv-cinder-84617 Jun 16 19:07:25.255635 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-96bea9cf-8b0e-4617-8662-071e27b88f23 req-ae6aac7b-86a3-43f4-a59d-ea2dd8a6ac8e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031788 Jun 16 19:07:25.256222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 566/1094] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:07:25.445168 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-132c544f-b3d3-4091-892c-bbfe76f12484 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:25.445827 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-132c544f-b3d3-4091-892c-bbfe76f12484 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:25.452677 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-132c544f-b3d3-4091-892c-bbfe76f12484 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:25.453963 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-132c544f-b3d3-4091-892c-bbfe76f12484 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:25.454770 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-132c544f-b3d3-4091-892c-bbfe76f12484 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:25.455233 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-132c544f-b3d3-4091-892c-bbfe76f12484 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:25.489223 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-132c544f-b3d3-4091-892c-bbfe76f12484 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:25.489698 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-132c544f-b3d3-4091-892c-bbfe76f12484 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:25.490351 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.objects.instance [None req-132c544f-b3d3-4091-892c-bbfe76f12484 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lazy-loading 'fault' on Instance uuid da4c1366-5e97-4a64-9307-dd4ba3f10ff3 {{(pid=130230) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:07:25.533190 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-132c544f-b3d3-4091-892c-bbfe76f12484 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:25.540863 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-132c544f-b3d3-4091-892c-bbfe76f12484 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 200 len: 1332 microversion: 2.1 time: 0.099768 Jun 16 19:07:25.541545 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 529/1095] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:25 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:26.559151 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-901ddaf4-aef6-4002-8131-744380386a87 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:26.559878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-901ddaf4-aef6-4002-8131-744380386a87 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:26.566071 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-901ddaf4-aef6-4002-8131-744380386a87 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:26.566516 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-901ddaf4-aef6-4002-8131-744380386a87 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:26.567283 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-901ddaf4-aef6-4002-8131-744380386a87 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:26.567731 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-901ddaf4-aef6-4002-8131-744380386a87 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:26.581029 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-901ddaf4-aef6-4002-8131-744380386a87 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] HTTP exception thrown: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-901ddaf4-aef6-4002-8131-744380386a87 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Request method failure captured: Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 HTTP/1.1 Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq36otl9Z_9Uiu0W2mg3FY9q2qgCS_Cc1PxlbzIDrBO8P3LU1ECIrM7T29od52OXBUcCnSlAwdyhzA3OZjSK1OKGpcp24QmnPZEy0Wk9nU6RvttgAU-rPxhRN2BqQnwtSWlyl3NKiQytbydUY3h7cF5WFM7v828GjpSevZojX3s7BtiE Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:07:26.582662 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:07:26.584090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cfa6530fe6dd49d88f41c57406f4cbb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cfa6530fe6dd49d88f41c57406f4cbb6"}]}] Jun 16 19:07:26.584090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:07:26.584090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:07:26.584090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:07:26.584090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:07:26.584090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:07:26.584090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:07:26.584090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 06722257713746f697d1f609c3956e05 Jun 16 19:07:26.584090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:07:26.584090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:07:26.584090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. Jun 16 19:07:26.584090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': 'da4c1366-5e97-4a64-9307-dd4ba3f10ff3'} Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:26.584899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. Jun 16 19:07:26.586455 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:07:26.587853 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-901ddaf4-aef6-4002-8131-744380386a87 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Returning 404 to user: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:26.587853 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-901ddaf4-aef6-4002-8131-744380386a87 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 404 len: 111 microversion: 2.1 time: 0.029579 Jun 16 19:07:26.587853 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 567/1096] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:26 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:07:26.593035 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3e49f31e-21be-4781-befa-095ea12e7cd8 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '.version_select at 0x7f20140c8ee0>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:26.654870 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3e49f31e-21be-4781-befa-095ea12e7cd8 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1206265946" status: 202 len: 0 microversion: 2.1 time: 0.065779 Jun 16 19:07:26.655362 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 530/1097] 10.222.0.81 () {58 vars in 1220 bytes} [Thu Jun 16 19:07:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1206265946 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:07:27.435813 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-47613bec-4a85-4e9c-9336-53b6943d8028 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Action: 'create', calling method: .version_select at 0x7f2018827670>, body: {"keypair": {"name": "tempest-keypair-947736860", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBeHAI7ADpSQIF0U7U4lfn+ZX6YYLDvpKu0oEJolphll8IpWvIq488w+dWQxSvkvBz2Gc7gfrFVN15aODwcsCxI+eytX8qLEjg5h0PBCRJ/hARSeOZ276ix4EqzPHc2cw=="}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:27.450107 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-47613bec-4a85-4e9c-9336-53b6943d8028 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'key_pairs'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:07:27.453946 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-47613bec-4a85-4e9c-9336-53b6943d8028 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for user 06722257713746f697d1f609c3956e05 and project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'key_pairs'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:07:27.574039 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-47613bec-4a85-4e9c-9336-53b6943d8028 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.142060 Jun 16 19:07:27.574694 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 568/1098] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jun 16 19:07:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:29.822708 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-835641236", "imageRef": "68f329df-2b85-4c54-bf47-15b9bc40db02", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f5b1bf4-16e2-474a-b72c-6a89096e68f2"}], "security_groups": [{"name": "tempest-securitygroup--1171160100"}], "key_name": "tempest-keypair-947736860", "user_data": "}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:29.923305 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.network.neutron [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] validate_networks() for [('9f5b1bf4-16e2-474a-b72c-6a89096e68f2', None, None, None, None, None)] {{(pid=130230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:07:30.289377 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Flavor limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:07:30.289803 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Image limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:07:30.290278 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Flavor pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:07:30.290681 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Image pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:07:30.291089 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:07:30.300134 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:30.300576 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:30.301435 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:30.301870 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:30.318063 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:07:30.321921 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Getting quotas for user 06722257713746f697d1f609c3956e05 and project cfa6530fe6dd49d88f41c57406f4cbb6. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:07:30.333268 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Going to run 1 instances... {{(pid=130230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:07:30.335473 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f329df-2b85-4c54-bf47-15b9bc40db02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:07:30.484767 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-09f54e5b-f482-480d-bc7a-a28b975e5d6f tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.666213 Jun 16 19:07:30.485465 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 531/1099] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 19:07:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 19:07:30.495884 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-77813336-a3a4-44c7-93de-e7eaf77c8e0c tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:30.496766 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-77813336-a3a4-44c7-93de-e7eaf77c8e0c tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:30.551425 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-77813336-a3a4-44c7-93de-e7eaf77c8e0c tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:30.558173 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-77813336-a3a4-44c7-93de-e7eaf77c8e0c tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 200 len: 1240 microversion: 2.1 time: 0.066502 Jun 16 19:07:30.558738 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 569/1100] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:30 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:31.575570 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-5e94d0f9-b1b7-477a-816d-7b66f845791d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:31.576185 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-5e94d0f9-b1b7-477a-816d-7b66f845791d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:31.583350 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5e94d0f9-b1b7-477a-816d-7b66f845791d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:31.585985 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5e94d0f9-b1b7-477a-816d-7b66f845791d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:31.585985 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5e94d0f9-b1b7-477a-816d-7b66f845791d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:31.585985 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-5e94d0f9-b1b7-477a-816d-7b66f845791d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:31.646433 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-5e94d0f9-b1b7-477a-816d-7b66f845791d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:31.654453 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-5e94d0f9-b1b7-477a-816d-7b66f845791d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 200 len: 1244 microversion: 2.1 time: 0.083092 Jun 16 19:07:31.655017 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 532/1101] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:31 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:32.675838 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0999519f-85b8-40d7-a262-e4162ff72786 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:32.676871 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0999519f-85b8-40d7-a262-e4162ff72786 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:32.684931 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0999519f-85b8-40d7-a262-e4162ff72786 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:32.685558 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0999519f-85b8-40d7-a262-e4162ff72786 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:32.686444 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0999519f-85b8-40d7-a262-e4162ff72786 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:32.687695 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0999519f-85b8-40d7-a262-e4162ff72786 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:32.759248 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0999519f-85b8-40d7-a262-e4162ff72786 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:32.766972 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0999519f-85b8-40d7-a262-e4162ff72786 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 200 len: 1298 microversion: 2.1 time: 0.096109 Jun 16 19:07:32.767768 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 570/1102] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:32 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:33.786429 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-98164c03-1463-4188-968a-a34fe96ed2a5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:33.787044 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-98164c03-1463-4188-968a-a34fe96ed2a5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:33.794784 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-98164c03-1463-4188-968a-a34fe96ed2a5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:33.795321 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-98164c03-1463-4188-968a-a34fe96ed2a5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:33.796729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-98164c03-1463-4188-968a-a34fe96ed2a5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:33.797420 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-98164c03-1463-4188-968a-a34fe96ed2a5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:34.008705 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-98164c03-1463-4188-968a-a34fe96ed2a5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:34.008705 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-98164c03-1463-4188-968a-a34fe96ed2a5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 200 len: 1366 microversion: 2.1 time: 0.225841 Jun 16 19:07:34.008705 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 533/1103] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:33 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:34.143961 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-2e05e0e2-79b2-4907-84f5-a5fbe6c1eb75 req-940a93d4-19f7-4beb-9943-6630c2d2739a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbd5bc0c-46e7-40c1-8168-a3eb426efa09", "tag": "5eeb2eff-0256-4b02-8bc3-13219dc24d3a"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:34.156130 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-2e05e0e2-79b2-4907-84f5-a5fbe6c1eb75 req-940a93d4-19f7-4beb-9943-6630c2d2739a service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:34.156803 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-2e05e0e2-79b2-4907-84f5-a5fbe6c1eb75 req-940a93d4-19f7-4beb-9943-6630c2d2739a service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:34.169299 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-2e05e0e2-79b2-4907-84f5-a5fbe6c1eb75 req-940a93d4-19f7-4beb-9943-6630c2d2739a service nova] Creating event network-changed:5eeb2eff-0256-4b02-8bc3-13219dc24d3a for instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 on hv-cinder-84617 Jun 16 19:07:34.174557 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-2e05e0e2-79b2-4907-84f5-a5fbe6c1eb75 req-940a93d4-19f7-4beb-9943-6630c2d2739a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035277 Jun 16 19:07:34.175197 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 571/1104] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:35.025557 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-afadf412-26dc-4ded-a516-4f7ca9622c90 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:35.026098 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-afadf412-26dc-4ded-a516-4f7ca9622c90 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:35.032588 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-afadf412-26dc-4ded-a516-4f7ca9622c90 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:35.033037 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-afadf412-26dc-4ded-a516-4f7ca9622c90 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:35.033830 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-afadf412-26dc-4ded-a516-4f7ca9622c90 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:35.034288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-afadf412-26dc-4ded-a516-4f7ca9622c90 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:35.163307 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-afadf412-26dc-4ded-a516-4f7ca9622c90 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:35.170707 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-afadf412-26dc-4ded-a516-4f7ca9622c90 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 200 len: 1366 microversion: 2.1 time: 0.149209 Jun 16 19:07:35.171831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 534/1105] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:35 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:36.189522 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b0b593e4-3512-4117-b445-153dd9855d94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:36.190217 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b0b593e4-3512-4117-b445-153dd9855d94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:36.196424 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b0b593e4-3512-4117-b445-153dd9855d94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:36.196863 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b0b593e4-3512-4117-b445-153dd9855d94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:36.197646 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b0b593e4-3512-4117-b445-153dd9855d94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:36.198075 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b0b593e4-3512-4117-b445-153dd9855d94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:36.324652 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b0b593e4-3512-4117-b445-153dd9855d94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:36.332590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b0b593e4-3512-4117-b445-153dd9855d94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 200 len: 1366 microversion: 2.1 time: 0.148328 Jun 16 19:07:36.333126 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 572/1106] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:36 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:37.349557 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f907db9e-193c-4304-b3f5-453aaee92cc1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:37.350168 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-f907db9e-193c-4304-b3f5-453aaee92cc1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:37.356684 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f907db9e-193c-4304-b3f5-453aaee92cc1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:37.357135 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f907db9e-193c-4304-b3f5-453aaee92cc1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:37.357929 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f907db9e-193c-4304-b3f5-453aaee92cc1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:37.358913 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-f907db9e-193c-4304-b3f5-453aaee92cc1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:37.491090 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-f907db9e-193c-4304-b3f5-453aaee92cc1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:37.498869 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f907db9e-193c-4304-b3f5-453aaee92cc1 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 200 len: 1366 microversion: 2.1 time: 0.153240 Jun 16 19:07:37.499420 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 535/1107] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:37 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:38.516407 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-2501e350-1390-4218-9e27-b11161440c72 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:38.517075 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-2501e350-1390-4218-9e27-b11161440c72 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:38.523595 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2501e350-1390-4218-9e27-b11161440c72 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:38.524054 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2501e350-1390-4218-9e27-b11161440c72 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:38.524829 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2501e350-1390-4218-9e27-b11161440c72 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:38.525308 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-2501e350-1390-4218-9e27-b11161440c72 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:38.651450 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-2501e350-1390-4218-9e27-b11161440c72 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:38.659477 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-2501e350-1390-4218-9e27-b11161440c72 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 200 len: 1366 microversion: 2.1 time: 0.147569 Jun 16 19:07:38.660040 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 573/1108] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:38 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:39.676544 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-115cef82-4b50-44d9-a537-591fdc2c2e92 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:39.677154 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-115cef82-4b50-44d9-a537-591fdc2c2e92 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:39.683702 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-115cef82-4b50-44d9-a537-591fdc2c2e92 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:39.684150 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-115cef82-4b50-44d9-a537-591fdc2c2e92 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:39.684914 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-115cef82-4b50-44d9-a537-591fdc2c2e92 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:39.685374 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-115cef82-4b50-44d9-a537-591fdc2c2e92 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:39.814895 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-115cef82-4b50-44d9-a537-591fdc2c2e92 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:39.822253 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-115cef82-4b50-44d9-a537-591fdc2c2e92 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 200 len: 1366 microversion: 2.1 time: 0.149590 Jun 16 19:07:39.822816 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 536/1109] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:39 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:40.839054 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b7228ae1-8a59-451b-9a84-d7072953a791 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:40.839746 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b7228ae1-8a59-451b-9a84-d7072953a791 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:40.842148 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=6 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:40.847626 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7228ae1-8a59-451b-9a84-d7072953a791 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:40.848041 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7228ae1-8a59-451b-9a84-d7072953a791 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:40.848805 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7228ae1-8a59-451b-9a84-d7072953a791 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:40.852221 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b7228ae1-8a59-451b-9a84-d7072953a791 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:40.976277 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-b7228ae1-8a59-451b-9a84-d7072953a791 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:40.983702 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b7228ae1-8a59-451b-9a84-d7072953a791 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 200 len: 1366 microversion: 2.1 time: 0.148568 Jun 16 19:07:40.985383 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 574/1110] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:40 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:41.239259 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:41.240036 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=6 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:41.297112 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-74ead013-6025-4058-8ebf-990d138c66ac req-74dfdc7f-8d5c-48d8-9032-883dd4ea54d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd5bc0c-46e7-40c1-8168-a3eb426efa09", "name": "network-vif-plugged", "status": "completed", "tag": "5eeb2eff-0256-4b02-8bc3-13219dc24d3a"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:41.305227 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-74ead013-6025-4058-8ebf-990d138c66ac req-74dfdc7f-8d5c-48d8-9032-883dd4ea54d8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:41.305644 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-74ead013-6025-4058-8ebf-990d138c66ac req-74dfdc7f-8d5c-48d8-9032-883dd4ea54d8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:41.318969 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-74ead013-6025-4058-8ebf-990d138c66ac req-74dfdc7f-8d5c-48d8-9032-883dd4ea54d8 service nova] Creating event network-vif-plugged:5eeb2eff-0256-4b02-8bc3-13219dc24d3a for instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 on hv-cinder-84617 Jun 16 19:07:41.323920 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-74ead013-6025-4058-8ebf-990d138c66ac req-74dfdc7f-8d5c-48d8-9032-883dd4ea54d8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089252 Jun 16 19:07:41.324487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 537/1111] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:42.000525 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c8119abb-0605-4385-ac09-c23d16a80348 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:42.001140 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c8119abb-0605-4385-ac09-c23d16a80348 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:42.007627 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c8119abb-0605-4385-ac09-c23d16a80348 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:42.008069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c8119abb-0605-4385-ac09-c23d16a80348 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:42.008836 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c8119abb-0605-4385-ac09-c23d16a80348 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:42.009298 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c8119abb-0605-4385-ac09-c23d16a80348 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:42.139975 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-c8119abb-0605-4385-ac09-c23d16a80348 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:42.147396 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c8119abb-0605-4385-ac09-c23d16a80348 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 200 len: 1366 microversion: 2.1 time: 0.150694 Jun 16 19:07:42.147953 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 575/1112] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:41 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:43.165553 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ac0c8655-240e-4b98-aa0a-e6f5abc49868 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:43.166259 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ac0c8655-240e-4b98-aa0a-e6f5abc49868 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:43.172834 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ac0c8655-240e-4b98-aa0a-e6f5abc49868 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:43.174746 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ac0c8655-240e-4b98-aa0a-e6f5abc49868 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:43.174746 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ac0c8655-240e-4b98-aa0a-e6f5abc49868 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:43.174746 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ac0c8655-240e-4b98-aa0a-e6f5abc49868 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:43.301389 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ac0c8655-240e-4b98-aa0a-e6f5abc49868 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:43.308799 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ac0c8655-240e-4b98-aa0a-e6f5abc49868 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 200 len: 1557 microversion: 2.1 time: 0.148652 Jun 16 19:07:43.309376 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 538/1113] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:43 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:43.324929 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-71b2ca8d-f62f-41f1-95ad-ab314945a2be tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:43.325483 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-71b2ca8d-f62f-41f1-95ad-ab314945a2be tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:43.328838 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:43.333607 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-71b2ca8d-f62f-41f1-95ad-ab314945a2be tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:43.334060 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-71b2ca8d-f62f-41f1-95ad-ab314945a2be tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:43.334831 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-71b2ca8d-f62f-41f1-95ad-ab314945a2be tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:43.335277 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-71b2ca8d-f62f-41f1-95ad-ab314945a2be tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:43.337633 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:43.413345 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-71b2ca8d-f62f-41f1-95ad-ab314945a2be tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092271 Jun 16 19:07:43.420787 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 576/1114] 10.222.0.81 () {58 vars in 1274 bytes} [Thu Jun 16 19:07:43 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:44.610902 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-a2a4cb0f-ef9e-48a9-a45f-28113ea694e6 req-37554da5-675f-4546-9965-ef07356637b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbd5bc0c-46e7-40c1-8168-a3eb426efa09", "tag": "5eeb2eff-0256-4b02-8bc3-13219dc24d3a"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:44.619461 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-a2a4cb0f-ef9e-48a9-a45f-28113ea694e6 req-37554da5-675f-4546-9965-ef07356637b8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:44.619844 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-a2a4cb0f-ef9e-48a9-a45f-28113ea694e6 req-37554da5-675f-4546-9965-ef07356637b8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:44.631052 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-a2a4cb0f-ef9e-48a9-a45f-28113ea694e6 req-37554da5-675f-4546-9965-ef07356637b8 service nova] Creating event network-changed:5eeb2eff-0256-4b02-8bc3-13219dc24d3a for instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 on hv-cinder-84617 Jun 16 19:07:44.636014 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-a2a4cb0f-ef9e-48a9-a45f-28113ea694e6 req-37554da5-675f-4546-9965-ef07356637b8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028863 Jun 16 19:07:44.636602 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 539/1115] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:20.871680 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c4bf9a84-30e6-4293-8185-8a122a533295 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:20.872285 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c4bf9a84-30e6-4293-8185-8a122a533295 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:20.879007 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c4bf9a84-30e6-4293-8185-8a122a533295 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:20.879456 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c4bf9a84-30e6-4293-8185-8a122a533295 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:20.880243 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c4bf9a84-30e6-4293-8185-8a122a533295 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:20.880680 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c4bf9a84-30e6-4293-8185-8a122a533295 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:20.903595 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c4bf9a84-30e6-4293-8185-8a122a533295 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09/ips" status: 200 len: 151 microversion: 2.1 time: 0.037393 Jun 16 19:08:20.904167 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 577/1116] 10.222.0.81 () {58 vars in 1247 bytes} [Thu Jun 16 19:08:20 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:22.579589 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:22.580337 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:22.584566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-67d73b0f-af4f-4405-8950-37a05aa3ca2e tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44b75d6a-9949-40ce-a116-8293771ec554"}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:22.585747 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-67d73b0f-af4f-4405-8950-37a05aa3ca2e tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:22.591796 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67d73b0f-af4f-4405-8950-37a05aa3ca2e tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:22.596013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67d73b0f-af4f-4405-8950-37a05aa3ca2e tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:22.596013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67d73b0f-af4f-4405-8950-37a05aa3ca2e tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:22.596013 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-67d73b0f-af4f-4405-8950-37a05aa3ca2e tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:23.521410 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-67d73b0f-af4f-4405-8950-37a05aa3ca2e tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "POST /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.942821 Jun 16 19:08:23.526990 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 540/1117] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jun 16 19:08:22 2022] POST /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09/os-volume_attachments => generated 194 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:31.096307 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b510fb0c-4eee-4dd9-aa8f-73f32b7df640 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:31.096858 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b510fb0c-4eee-4dd9-aa8f-73f32b7df640 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:31.098719 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=3 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:31.103639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b510fb0c-4eee-4dd9-aa8f-73f32b7df640 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:31.106159 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b510fb0c-4eee-4dd9-aa8f-73f32b7df640 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:31.106159 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b510fb0c-4eee-4dd9-aa8f-73f32b7df640 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:31.106159 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b510fb0c-4eee-4dd9-aa8f-73f32b7df640 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:31.185441 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-b510fb0c-4eee-4dd9-aa8f-73f32b7df640 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lazy-loading 'services' on Instance uuid cbd5bc0c-46e7-40c1-8168-a3eb426efa09 {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:08:31.411113 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b510fb0c-4eee-4dd9-aa8f-73f32b7df640 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09/os-volume_attachments/44b75d6a-9949-40ce-a116-8293771ec554" status: 202 len: 0 microversion: 2.1 time: 0.319414 Jun 16 19:08:31.411635 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 578/1118] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jun 16 19:08:31 2022] DELETE /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09/os-volume_attachments/44b75d6a-9949-40ce-a116-8293771ec554 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:08:31.421679 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4a5b5cef-1b31-46af-8b15-a4bf27dab3a3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:31.422706 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4a5b5cef-1b31-46af-8b15-a4bf27dab3a3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:31.429032 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4a5b5cef-1b31-46af-8b15-a4bf27dab3a3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:31.429533 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4a5b5cef-1b31-46af-8b15-a4bf27dab3a3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:31.430306 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4a5b5cef-1b31-46af-8b15-a4bf27dab3a3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:31.430748 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4a5b5cef-1b31-46af-8b15-a4bf27dab3a3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:31.460174 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4a5b5cef-1b31-46af-8b15-a4bf27dab3a3 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044034 Jun 16 19:08:31.460726 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 541/1119] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:08:31 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:32.473079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3d645fe8-6b1d-4bd5-9a9c-528ff216c997 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:32.474180 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3d645fe8-6b1d-4bd5-9a9c-528ff216c997 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:32.480963 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3d645fe8-6b1d-4bd5-9a9c-528ff216c997 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:32.481439 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3d645fe8-6b1d-4bd5-9a9c-528ff216c997 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:32.482259 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3d645fe8-6b1d-4bd5-9a9c-528ff216c997 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:32.482695 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3d645fe8-6b1d-4bd5-9a9c-528ff216c997 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:32.511369 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3d645fe8-6b1d-4bd5-9a9c-528ff216c997 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043131 Jun 16 19:08:32.511907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 579/1120] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:08:32 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:08:32.567350 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-a297fa58-2981-4b59-91b1-ce7086130d83 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:32.567853 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a297fa58-2981-4b59-91b1-ce7086130d83 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:32.574341 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a297fa58-2981-4b59-91b1-ce7086130d83 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:32.574787 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a297fa58-2981-4b59-91b1-ce7086130d83 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:32.575549 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a297fa58-2981-4b59-91b1-ce7086130d83 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:32.576005 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-a297fa58-2981-4b59-91b1-ce7086130d83 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:32.601947 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-a297fa58-2981-4b59-91b1-ce7086130d83 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Going to try to terminate instance {{(pid=130230) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:08:32.895710 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-a297fa58-2981-4b59-91b1-ce7086130d83 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 204 len: 0 microversion: 2.1 time: 0.331964 Jun 16 19:08:32.896305 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 542/1121] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:08:32 2022] DELETE /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:08:32.905071 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-3679e59d-d1e5-4979-8a10-0fee95dfbde5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:32.905709 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-3679e59d-d1e5-4979-8a10-0fee95dfbde5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:32.911715 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3679e59d-d1e5-4979-8a10-0fee95dfbde5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:32.919585 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3679e59d-d1e5-4979-8a10-0fee95dfbde5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:32.919585 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3679e59d-d1e5-4979-8a10-0fee95dfbde5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:32.919585 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-3679e59d-d1e5-4979-8a10-0fee95dfbde5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:33.044389 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-3679e59d-d1e5-4979-8a10-0fee95dfbde5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:33.051836 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-3679e59d-d1e5-4979-8a10-0fee95dfbde5 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 200 len: 1682 microversion: 2.1 time: 0.151139 Jun 16 19:08:33.052395 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 580/1122] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:32 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:34.069276 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9fc0e3e1-896a-4a6a-a77e-5fab99b4c7a2 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:34.069979 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9fc0e3e1-896a-4a6a-a77e-5fab99b4c7a2 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:34.076925 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9fc0e3e1-896a-4a6a-a77e-5fab99b4c7a2 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:34.077396 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9fc0e3e1-896a-4a6a-a77e-5fab99b4c7a2 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:34.078148 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9fc0e3e1-896a-4a6a-a77e-5fab99b4c7a2 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:34.078580 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9fc0e3e1-896a-4a6a-a77e-5fab99b4c7a2 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:34.207248 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9fc0e3e1-896a-4a6a-a77e-5fab99b4c7a2 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:34.214693 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9fc0e3e1-896a-4a6a-a77e-5fab99b4c7a2 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 200 len: 1682 microversion: 2.1 time: 0.149673 Jun 16 19:08:34.215250 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 543/1123] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:34 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:35.231953 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8dbb9bd9-a722-4a54-9c48-6a2e5f8967d6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:35.232563 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8dbb9bd9-a722-4a54-9c48-6a2e5f8967d6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:35.238945 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8dbb9bd9-a722-4a54-9c48-6a2e5f8967d6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:35.239391 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8dbb9bd9-a722-4a54-9c48-6a2e5f8967d6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:35.240159 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8dbb9bd9-a722-4a54-9c48-6a2e5f8967d6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:35.240598 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8dbb9bd9-a722-4a54-9c48-6a2e5f8967d6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:35.348588 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8dbb9bd9-a722-4a54-9c48-6a2e5f8967d6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06722257713746f697d1f609c3956e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa6530fe6dd49d88f41c57406f4cbb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:35.352691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-e9773ef5-9712-47c1-a524-a1822ba98b23 req-f8e372a5-7c59-47c8-afb7-cbd13fd49ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbd5bc0c-46e7-40c1-8168-a3eb426efa09", "name": "network-vif-deleted", "tag": "5eeb2eff-0256-4b02-8bc3-13219dc24d3a"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:35.357228 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8dbb9bd9-a722-4a54-9c48-6a2e5f8967d6 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 200 len: 1614 microversion: 2.1 time: 0.129586 Jun 16 19:08:35.357956 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 581/1124] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:35 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 1614 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:35.365573 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-e9773ef5-9712-47c1-a524-a1822ba98b23 req-f8e372a5-7c59-47c8-afb7-cbd13fd49ad8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:35.368999 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-e9773ef5-9712-47c1-a524-a1822ba98b23 req-f8e372a5-7c59-47c8-afb7-cbd13fd49ad8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:35.386422 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-e9773ef5-9712-47c1-a524-a1822ba98b23 req-f8e372a5-7c59-47c8-afb7-cbd13fd49ad8 service nova] Creating event network-vif-deleted:5eeb2eff-0256-4b02-8bc3-13219dc24d3a for instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 on hv-cinder-84617 Jun 16 19:08:35.391394 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-e9773ef5-9712-47c1-a524-a1822ba98b23 req-f8e372a5-7c59-47c8-afb7-cbd13fd49ad8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049752 Jun 16 19:08:35.392422 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 544/1125] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:36.375175 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-45579314-31db-4199-bae6-6845c505d018 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:36.375876 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-45579314-31db-4199-bae6-6845c505d018 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:36.382284 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-45579314-31db-4199-bae6-6845c505d018 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:36.382732 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-45579314-31db-4199-bae6-6845c505d018 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:36.383519 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-45579314-31db-4199-bae6-6845c505d018 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:36.383946 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-45579314-31db-4199-bae6-6845c505d018 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:36.397695 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-45579314-31db-4199-bae6-6845c505d018 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] HTTP exception thrown: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-45579314-31db-4199-bae6-6845c505d018 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Request method failure captured: Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 HTTP/1.1 Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq36otl9Z_9Uiu0W2mg3FY9q2qgCS_Cc1PxlbzIDrBO8P3LU1ECIrM7T29od52OXBUcCnSlAwdyhzA3OZjSK1OKGpcp24QmnPZEy0Wk9nU6RvttgAU-rPxhRN2BqQnwtSWlyl3NKiQytbydUY3h7cF5WFM7v828GjpSevZojX3s7BtiE Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:08:36.401620 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:08:36.403100 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cfa6530fe6dd49d88f41c57406f4cbb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cfa6530fe6dd49d88f41c57406f4cbb6"}]}] Jun 16 19:08:36.403100 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:36.403100 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:36.403100 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:36.403100 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:36.403100 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:08:36.403100 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:08:36.403100 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 06722257713746f697d1f609c3956e05 Jun 16 19:08:36.403100 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:36.403100 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:08:36.403100 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. Jun 16 19:08:36.403100 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': 'cbd5bc0c-46e7-40c1-8168-a3eb426efa09'} Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:08:36.403889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. Jun 16 19:08:36.405200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:36.406463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-45579314-31db-4199-bae6-6845c505d018 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Returning 404 to user: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:08:36.406463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-45579314-31db-4199-bae6-6845c505d018 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 404 len: 111 microversion: 2.1 time: 0.029505 Jun 16 19:08:36.406463 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 582/1126] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:36 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:08:36.410303 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-f1b8b367-cc4a-452f-a740-49d5481f2757 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '.version_select at 0x7f2014097e50>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:36.521439 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-f1b8b367-cc4a-452f-a740-49d5481f2757 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-947736860" status: 202 len: 0 microversion: 2.1 time: 0.115204 Jun 16 19:08:36.522166 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 545/1127] 10.222.0.81 () {58 vars in 1217 bytes} [Thu Jun 16 19:08:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-947736860 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:08:38.561747 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a486818a-d36b-48a7-a19a-aa3e3b949e81 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:38.562254 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-a486818a-d36b-48a7-a19a-aa3e3b949e81 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:38.568834 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a486818a-d36b-48a7-a19a-aa3e3b949e81 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:38.569313 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a486818a-d36b-48a7-a19a-aa3e3b949e81 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:38.570087 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a486818a-d36b-48a7-a19a-aa3e3b949e81 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:38.570530 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-a486818a-d36b-48a7-a19a-aa3e3b949e81 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:38.583707 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-a486818a-d36b-48a7-a19a-aa3e3b949e81 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] HTTP exception thrown: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a486818a-d36b-48a7-a19a-aa3e3b949e81 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Request method failure captured: Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: DELETE /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 HTTP/1.1 Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq36otl9Z_9Uiu0W2mg3FY9q2qgCS_Cc1PxlbzIDrBO8P3LU1ECIrM7T29od52OXBUcCnSlAwdyhzA3OZjSK1OKGpcp24QmnPZEy0Wk9nU6RvttgAU-rPxhRN2BqQnwtSWlyl3NKiQytbydUY3h7cF5WFM7v828GjpSevZojX3s7BtiE Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:08:38.585222 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:08:38.586912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cfa6530fe6dd49d88f41c57406f4cbb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cfa6530fe6dd49d88f41c57406f4cbb6"}]}] Jun 16 19:08:38.586912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:38.586912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:38.586912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:38.586912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:38.586912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:08:38.586912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:08:38.586912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 06722257713746f697d1f609c3956e05 Jun 16 19:08:38.586912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:38.586912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:08:38.586912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. Jun 16 19:08:38.586912 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': 'cbd5bc0c-46e7-40c1-8168-a3eb426efa09'} Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:08:38.588036 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. Jun 16 19:08:38.590067 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:38.591594 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-a486818a-d36b-48a7-a19a-aa3e3b949e81 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Returning 404 to user: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:08:38.591594 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-a486818a-d36b-48a7-a19a-aa3e3b949e81 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "DELETE /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 404 len: 111 microversion: 2.1 time: 0.029321 Jun 16 19:08:38.591594 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 583/1128] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:08:38 2022] DELETE /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:08:38.595861 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-50c4130f-c761-4393-935d-5552101c7723 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:38.596598 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-50c4130f-c761-4393-935d-5552101c7723 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: cbd5bc0c-46e7-40c1-8168-a3eb426efa09] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:38.603255 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-50c4130f-c761-4393-935d-5552101c7723 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:38.603708 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-50c4130f-c761-4393-935d-5552101c7723 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:38.604477 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-50c4130f-c761-4393-935d-5552101c7723 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:38.605502 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-50c4130f-c761-4393-935d-5552101c7723 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:38.618456 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-50c4130f-c761-4393-935d-5552101c7723 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] HTTP exception thrown: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-50c4130f-c761-4393-935d-5552101c7723 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Request method failure captured: Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 HTTP/1.1 Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq36otl9Z_9Uiu0W2mg3FY9q2qgCS_Cc1PxlbzIDrBO8P3LU1ECIrM7T29od52OXBUcCnSlAwdyhzA3OZjSK1OKGpcp24QmnPZEy0Wk9nU6RvttgAU-rPxhRN2BqQnwtSWlyl3NKiQytbydUY3h7cF5WFM7v828GjpSevZojX3s7BtiE Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:08:38.619994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:08:38.621968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cfa6530fe6dd49d88f41c57406f4cbb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cfa6530fe6dd49d88f41c57406f4cbb6"}]}] Jun 16 19:08:38.621968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:38.621968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:38.621968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:38.621968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:38.621968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:08:38.621968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:08:38.621968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 06722257713746f697d1f609c3956e05 Jun 16 19:08:38.621968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:38.621968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:08:38.621968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. Jun 16 19:08:38.621968 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': 'cbd5bc0c-46e7-40c1-8168-a3eb426efa09'} Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:08:38.623039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. Jun 16 19:08:38.624519 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:38.625987 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-50c4130f-c761-4393-935d-5552101c7723 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Returning 404 to user: Instance cbd5bc0c-46e7-40c1-8168-a3eb426efa09 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:08:38.625987 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-50c4130f-c761-4393-935d-5552101c7723 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09" status: 404 len: 111 microversion: 2.1 time: 0.030148 Jun 16 19:08:38.625987 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 546/1129] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:38 2022] GET /compute/v2.1/servers/cbd5bc0c-46e7-40c1-8168-a3eb426efa09 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:08:39.891069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-95af4ecf-a08d-48a4-bf2f-81628b47db28 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:39.891571 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-95af4ecf-a08d-48a4-bf2f-81628b47db28 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:39.898017 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-95af4ecf-a08d-48a4-bf2f-81628b47db28 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:39.898472 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-95af4ecf-a08d-48a4-bf2f-81628b47db28 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:39.899238 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-95af4ecf-a08d-48a4-bf2f-81628b47db28 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:39.899679 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-95af4ecf-a08d-48a4-bf2f-81628b47db28 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:39.913663 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-95af4ecf-a08d-48a4-bf2f-81628b47db28 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] HTTP exception thrown: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-95af4ecf-a08d-48a4-bf2f-81628b47db28 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Request method failure captured: Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: DELETE /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 HTTP/1.1 Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq36otl9Z_9Uiu0W2mg3FY9q2qgCS_Cc1PxlbzIDrBO8P3LU1ECIrM7T29od52OXBUcCnSlAwdyhzA3OZjSK1OKGpcp24QmnPZEy0Wk9nU6RvttgAU-rPxhRN2BqQnwtSWlyl3NKiQytbydUY3h7cF5WFM7v828GjpSevZojX3s7BtiE Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:08:39.915192 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:08:39.916786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cfa6530fe6dd49d88f41c57406f4cbb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cfa6530fe6dd49d88f41c57406f4cbb6"}]}] Jun 16 19:08:39.916786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:39.916786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:39.916786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:39.916786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:39.916786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:08:39.916786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:08:39.916786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 06722257713746f697d1f609c3956e05 Jun 16 19:08:39.916786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:39.916786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:08:39.916786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. Jun 16 19:08:39.916786 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': 'da4c1366-5e97-4a64-9307-dd4ba3f10ff3'} Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:08:39.917919 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. Jun 16 19:08:39.919400 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:39.921001 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-95af4ecf-a08d-48a4-bf2f-81628b47db28 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Returning 404 to user: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:08:39.921001 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-95af4ecf-a08d-48a4-bf2f-81628b47db28 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "DELETE /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 404 len: 111 microversion: 2.1 time: 0.029408 Jun 16 19:08:39.921001 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 584/1130] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:08:39 2022] DELETE /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:08:39.924633 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ba927cf0-4777-48b7-bda5-7f74ecbbb93d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:39.925266 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ba927cf0-4777-48b7-bda5-7f74ecbbb93d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: da4c1366-5e97-4a64-9307-dd4ba3f10ff3] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:39.931505 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ba927cf0-4777-48b7-bda5-7f74ecbbb93d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:39.931957 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ba927cf0-4777-48b7-bda5-7f74ecbbb93d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:39.932724 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ba927cf0-4777-48b7-bda5-7f74ecbbb93d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:39.933166 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ba927cf0-4777-48b7-bda5-7f74ecbbb93d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:39.946464 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-ba927cf0-4777-48b7-bda5-7f74ecbbb93d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] HTTP exception thrown: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ba927cf0-4777-48b7-bda5-7f74ecbbb93d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Request method failure captured: Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 HTTP/1.1 Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq36otl9Z_9Uiu0W2mg3FY9q2qgCS_Cc1PxlbzIDrBO8P3LU1ECIrM7T29od52OXBUcCnSlAwdyhzA3OZjSK1OKGpcp24QmnPZEy0Wk9nU6RvttgAU-rPxhRN2BqQnwtSWlyl3NKiQytbydUY3h7cF5WFM7v828GjpSevZojX3s7BtiE Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:08:39.947972 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:08:39.950075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cfa6530fe6dd49d88f41c57406f4cbb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cfa6530fe6dd49d88f41c57406f4cbb6"}]}] Jun 16 19:08:39.950075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:39.950075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:39.950075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:39.950075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:39.950075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:08:39.950075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:08:39.950075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 06722257713746f697d1f609c3956e05 Jun 16 19:08:39.950075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:39.950075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:08:39.950075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. Jun 16 19:08:39.950075 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': 'da4c1366-5e97-4a64-9307-dd4ba3f10ff3'} Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:08:39.951028 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. Jun 16 19:08:39.952270 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:39.953511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ba927cf0-4777-48b7-bda5-7f74ecbbb93d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Returning 404 to user: Instance da4c1366-5e97-4a64-9307-dd4ba3f10ff3 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:08:39.953511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ba927cf0-4777-48b7-bda5-7f74ecbbb93d tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3" status: 404 len: 111 microversion: 2.1 time: 0.028954 Jun 16 19:08:39.953511 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 547/1131] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:39 2022] GET /compute/v2.1/servers/da4c1366-5e97-4a64-9307-dd4ba3f10ff3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:08:39.957990 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-369372b3-0dda-4399-829e-cfe190f6aa12 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:39.958492 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-369372b3-0dda-4399-829e-cfe190f6aa12 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:39.964961 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-369372b3-0dda-4399-829e-cfe190f6aa12 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:39.965442 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-369372b3-0dda-4399-829e-cfe190f6aa12 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:39.966208 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-369372b3-0dda-4399-829e-cfe190f6aa12 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:39.966676 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-369372b3-0dda-4399-829e-cfe190f6aa12 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:39.980378 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-369372b3-0dda-4399-829e-cfe190f6aa12 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] HTTP exception thrown: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-369372b3-0dda-4399-829e-cfe190f6aa12 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Request method failure captured: Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: DELETE /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 HTTP/1.1 Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq36otl9Z_9Uiu0W2mg3FY9q2qgCS_Cc1PxlbzIDrBO8P3LU1ECIrM7T29od52OXBUcCnSlAwdyhzA3OZjSK1OKGpcp24QmnPZEy0Wk9nU6RvttgAU-rPxhRN2BqQnwtSWlyl3NKiQytbydUY3h7cF5WFM7v828GjpSevZojX3s7BtiE Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:08:39.981968 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:08:39.983590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cfa6530fe6dd49d88f41c57406f4cbb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cfa6530fe6dd49d88f41c57406f4cbb6"}]}] Jun 16 19:08:39.983590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:39.983590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:39.983590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:39.983590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:39.983590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:08:39.983590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:08:39.983590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 06722257713746f697d1f609c3956e05 Jun 16 19:08:39.983590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:39.983590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:08:39.983590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. Jun 16 19:08:39.983590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': 'aca7511d-0f9a-4fb8-b715-402bd7ddef94'} Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:08:39.984684 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. Jun 16 19:08:39.986216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:39.988073 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-369372b3-0dda-4399-829e-cfe190f6aa12 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Returning 404 to user: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:08:39.988073 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-369372b3-0dda-4399-829e-cfe190f6aa12 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "DELETE /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 404 len: 111 microversion: 2.1 time: 0.029114 Jun 16 19:08:39.988073 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 585/1132] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:08:39 2022] DELETE /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:08:39.991782 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b5a2f7a8-f829-43e2-b961-5fd7ee442c94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:39.992439 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b5a2f7a8-f829-43e2-b961-5fd7ee442c94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: aca7511d-0f9a-4fb8-b715-402bd7ddef94] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:39.999290 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b5a2f7a8-f829-43e2-b961-5fd7ee442c94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:39.999744 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b5a2f7a8-f829-43e2-b961-5fd7ee442c94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:40.000523 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b5a2f7a8-f829-43e2-b961-5fd7ee442c94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:40.000962 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b5a2f7a8-f829-43e2-b961-5fd7ee442c94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:40.014818 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-b5a2f7a8-f829-43e2-b961-5fd7ee442c94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] HTTP exception thrown: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b5a2f7a8-f829-43e2-b961-5fd7ee442c94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Request method failure captured: Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 HTTP/1.1 Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq36otl9Z_9Uiu0W2mg3FY9q2qgCS_Cc1PxlbzIDrBO8P3LU1ECIrM7T29od52OXBUcCnSlAwdyhzA3OZjSK1OKGpcp24QmnPZEy0Wk9nU6RvttgAU-rPxhRN2BqQnwtSWlyl3NKiQytbydUY3h7cF5WFM7v828GjpSevZojX3s7BtiE Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:08:40.016344 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:08:40.017974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cfa6530fe6dd49d88f41c57406f4cbb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cfa6530fe6dd49d88f41c57406f4cbb6"}]}] Jun 16 19:08:40.017974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:40.017974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:40.017974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:40.017974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:40.017974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:08:40.017974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:08:40.017974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 06722257713746f697d1f609c3956e05 Jun 16 19:08:40.017974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:40.017974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:08:40.017974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. Jun 16 19:08:40.017974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': 'aca7511d-0f9a-4fb8-b715-402bd7ddef94'} Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:08:40.019066 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. Jun 16 19:08:40.020581 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:40.022083 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b5a2f7a8-f829-43e2-b961-5fd7ee442c94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Returning 404 to user: Instance aca7511d-0f9a-4fb8-b715-402bd7ddef94 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:08:40.022083 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b5a2f7a8-f829-43e2-b961-5fd7ee442c94 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94" status: 404 len: 111 microversion: 2.1 time: 0.029868 Jun 16 19:08:40.022083 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 548/1133] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:39 2022] GET /compute/v2.1/servers/aca7511d-0f9a-4fb8-b715-402bd7ddef94 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:08:41.328523 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8e3addfe-c946-40ac-adbc-120fd7f3f86c tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:41.329025 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8e3addfe-c946-40ac-adbc-120fd7f3f86c tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:41.335516 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8e3addfe-c946-40ac-adbc-120fd7f3f86c tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:41.336090 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8e3addfe-c946-40ac-adbc-120fd7f3f86c tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:41.336843 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8e3addfe-c946-40ac-adbc-120fd7f3f86c tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:41.337301 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8e3addfe-c946-40ac-adbc-120fd7f3f86c tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:41.356807 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.wsgi [None req-8e3addfe-c946-40ac-adbc-120fd7f3f86c tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] HTTP exception thrown: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8e3addfe-c946-40ac-adbc-120fd7f3f86c tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Request method failure captured: Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: request: DELETE /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 HTTP/1.1 Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept: application/json Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Accept-Encoding: identity Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Connection: close Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Length: 0 Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Content-Type: application/json Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Host: 10.222.0.81 Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Openstack-System-Scope: None Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: User-Agent: python-urllib3/1.26.9 Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Auth-Token: gAAAAABiq36otl9Z_9Uiu0W2mg3FY9q2qgCS_Cc1PxlbzIDrBO8P3LU1ECIrM7T29od52OXBUcCnSlAwdyhzA3OZjSK1OKGpcp24QmnPZEy0Wk9nU6RvttgAU-rPxhRN2BqQnwtSWlyl3NKiQytbydUY3h7cF5WFM7v828GjpSevZojX3s7BtiE Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Id: None Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Domain-Name: None Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Identity-Status: Confirmed Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Is-Admin-Project: True Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Id: default Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Domain-Name: Default Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Project-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Role: member,reader Jun 16 19:08:41.358459 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Roles: member,reader Jun 16 19:08:41.359878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cfa6530fe6dd49d88f41c57406f4cbb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cfa6530fe6dd49d88f41c57406f4cbb6"}]}] Jun 16 19:08:41.359878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:41.359878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:41.359878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:41.359878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:41.359878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Id: default Jun 16 19:08:41.359878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Domain-Name: Default Jun 16 19:08:41.359878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Id: 06722257713746f697d1f609c3956e05 Jun 16 19:08:41.359878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: X-User-Name: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:41.359878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: method: > Jun 16 19:08:41.359878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: exception: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. Jun 16 19:08:41.359878 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: action_args: {'id': '8a69da73-7a7e-4f27-b52f-1bec2f65f145'} Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:08:41.360671 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. Jun 16 19:08:41.362079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: ERROR nova.api.openstack.wsgi Jun 16 19:08:41.363364 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8e3addfe-c946-40ac-adbc-120fd7f3f86c tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Returning 404 to user: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. {{(pid=130229) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:08:41.363364 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8e3addfe-c946-40ac-adbc-120fd7f3f86c tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 404 len: 111 microversion: 2.1 time: 0.035299 Jun 16 19:08:41.363364 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 586/1134] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:08:41 2022] DELETE /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:08:41.368628 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-7122d285-8b42-4ff2-a319-c562f45207c9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:41.369264 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-7122d285-8b42-4ff2-a319-c562f45207c9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] [instance: 8a69da73-7a7e-4f27-b52f-1bec2f65f145] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:41.376096 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7122d285-8b42-4ff2-a319-c562f45207c9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:41.376550 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7122d285-8b42-4ff2-a319-c562f45207c9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:41.377352 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7122d285-8b42-4ff2-a319-c562f45207c9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:41.377802 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-7122d285-8b42-4ff2-a319-c562f45207c9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:41.392117 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-7122d285-8b42-4ff2-a319-c562f45207c9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] HTTP exception thrown: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-7122d285-8b42-4ff2-a319-c562f45207c9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Request method failure captured: Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 HTTP/1.1 Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq36otl9Z_9Uiu0W2mg3FY9q2qgCS_Cc1PxlbzIDrBO8P3LU1ECIrM7T29od52OXBUcCnSlAwdyhzA3OZjSK1OKGpcp24QmnPZEy0Wk9nU6RvttgAU-rPxhRN2BqQnwtSWlyl3NKiQytbydUY3h7cF5WFM7v828GjpSevZojX3s7BtiE Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:08:41.393691 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:08:41.395288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_cfa6530fe6dd49d88f41c57406f4cbb6", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/cfa6530fe6dd49d88f41c57406f4cbb6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/cfa6530fe6dd49d88f41c57406f4cbb6"}]}] Jun 16 19:08:41.395288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:41.395288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: cfa6530fe6dd49d88f41c57406f4cbb6 Jun 16 19:08:41.395288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1239918526 Jun 16 19:08:41.395288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:41.395288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:08:41.395288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:08:41.395288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: 06722257713746f697d1f609c3956e05 Jun 16 19:08:41.395288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-AttachVolumeNegativeTest-1239918526-project Jun 16 19:08:41.395288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:08:41.395288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. Jun 16 19:08:41.395288 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': '8a69da73-7a7e-4f27-b52f-1bec2f65f145'} Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:08:41.396202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. Jun 16 19:08:41.397831 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:08:41.399202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-7122d285-8b42-4ff2-a319-c562f45207c9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] Returning 404 to user: Instance 8a69da73-7a7e-4f27-b52f-1bec2f65f145 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:08:41.399202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-7122d285-8b42-4ff2-a319-c562f45207c9 tempest-AttachVolumeNegativeTest-1239918526 tempest-AttachVolumeNegativeTest-1239918526-project] 10.222.0.81 "GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145" status: 404 len: 111 microversion: 2.1 time: 0.030380 Jun 16 19:08:41.399202 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 549/1135] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:41 2022] GET /compute/v2.1/servers/8a69da73-7a7e-4f27-b52f-1bec2f65f145 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:09:29.576278 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:09:29.576797 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Thu Jun 16 19:09:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:10:16.648986 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=18 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:16.649836 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:16.654298 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ece239a3-75a5-4244-8312-180f9dd8e006 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Action: 'create', calling method: .version_select at 0x7f2018866ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1336293055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5x3+xVFQ0rHZ4CZDY/WyODpjprqRpZzDjmpwQqjFz6E7jSp2jrz/3SDfaSGwHxsF6m4StB+T9PcY82A5MDTFqYrQksOYIbbIZfcXgVNKxTzes+WbavlhDYC0tU78xfVg=="}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:16.668022 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-ece239a3-75a5-4244-8312-180f9dd8e006 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Getting quotas for project 434965eee025410ca595f90a8bd80ee5. Resources: {'key_pairs'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:10:16.672418 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.quota [None req-ece239a3-75a5-4244-8312-180f9dd8e006 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Getting quotas for user a52eccb2ea4b4920863f4e74e75296ab and project 434965eee025410ca595f90a8bd80ee5. Resources: {'key_pairs'} {{(pid=130229) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:10:16.800647 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ece239a3-75a5-4244-8312-180f9dd8e006 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.153335 Jun 16 19:10:16.801228 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 587/1136] 10.222.0.81 () {60 vars in 1158 bytes} [Thu Jun 16 19:10:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:10:16.848832 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:16.849619 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:16.853533 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1826370595", "imageRef": "b287e958-551e-4ebe-b352-f65949041e8d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1336293055", "networks": [{"uuid": "8ac31b9c-4b91-4420-8c18-00bfa7a64c28"}]}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:16.903840 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.network.neutron [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] validate_networks() for [('8ac31b9c-4b91-4420-8c18-00bfa7a64c28', None, None, None, None, None)] {{(pid=130230) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:10:17.357002 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Flavor limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:10:17.357481 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Image limits 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:10:17.357992 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Flavor pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:10:17.358410 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Image pref 0:0:0 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:10:17.358834 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.virt.hardware [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130230) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:10:17.367571 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:17.368025 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:17.368829 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:17.369291 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:17.386353 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Getting quotas for project 434965eee025410ca595f90a8bd80ee5. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:10:17.390823 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.quota [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Getting quotas for user a52eccb2ea4b4920863f4e74e75296ab and project 434965eee025410ca595f90a8bd80ee5. Resources: {'cores', 'ram', 'instances'} {{(pid=130230) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:10:17.401648 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Going to run 1 instances... {{(pid=130230) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:10:17.403909 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b287e958-551e-4ebe-b352-f65949041e8d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130230) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:10:17.526899 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b140f605-2a3b-4407-a4c1-3933bed873c2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679840 Jun 16 19:10:17.527607 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 550/1137] 10.222.0.81 () {60 vars in 1146 bytes} [Thu Jun 16 19:10:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 19:10:17.538128 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-271dae6c-c4d8-4d5b-8867-334812aba14b tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:17.538769 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-271dae6c-c4d8-4d5b-8867-334812aba14b tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:17.595622 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-271dae6c-c4d8-4d5b-8867-334812aba14b tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:17.602267 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-271dae6c-c4d8-4d5b-8867-334812aba14b tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1259 microversion: 2.1 time: 0.068481 Jun 16 19:10:17.602841 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 588/1138] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:17 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:18.619715 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-18e885d0-95b5-4691-9c90-dfe25576fa59 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:18.620456 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-18e885d0-95b5-4691-9c90-dfe25576fa59 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:18.673800 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-18e885d0-95b5-4691-9c90-dfe25576fa59 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:18.681167 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-18e885d0-95b5-4691-9c90-dfe25576fa59 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1259 microversion: 2.1 time: 0.066112 Jun 16 19:10:18.681745 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 551/1139] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:18 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1259 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:19.697257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-39ec8842-89ad-4579-b6e2-147bbcda2cf5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:19.697877 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-39ec8842-89ad-4579-b6e2-147bbcda2cf5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:19.705078 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-39ec8842-89ad-4579-b6e2-147bbcda2cf5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:19.705557 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-39ec8842-89ad-4579-b6e2-147bbcda2cf5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:19.706331 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-39ec8842-89ad-4579-b6e2-147bbcda2cf5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:19.706769 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-39ec8842-89ad-4579-b6e2-147bbcda2cf5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:19.767569 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-39ec8842-89ad-4579-b6e2-147bbcda2cf5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:19.775200 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-39ec8842-89ad-4579-b6e2-147bbcda2cf5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1311 microversion: 2.1 time: 0.081918 Jun 16 19:10:19.775760 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 589/1140] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:19 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1311 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:20.800865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-49240805-7209-4097-9c4f-97655388fe4f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:20.802194 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-49240805-7209-4097-9c4f-97655388fe4f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:20.816296 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-49240805-7209-4097-9c4f-97655388fe4f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:20.817071 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-49240805-7209-4097-9c4f-97655388fe4f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:20.818164 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-49240805-7209-4097-9c4f-97655388fe4f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:20.818820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-49240805-7209-4097-9c4f-97655388fe4f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:20.997906 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-49240805-7209-4097-9c4f-97655388fe4f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:21.007324 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-49240805-7209-4097-9c4f-97655388fe4f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1359 microversion: 2.1 time: 0.211055 Jun 16 19:10:21.008009 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 552/1141] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:20 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:22.024812 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-372d4c3d-7700-4302-bdd7-02b76200acf4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:22.025652 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-372d4c3d-7700-4302-bdd7-02b76200acf4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:22.038788 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-372d4c3d-7700-4302-bdd7-02b76200acf4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:22.039231 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-372d4c3d-7700-4302-bdd7-02b76200acf4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:22.040038 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-372d4c3d-7700-4302-bdd7-02b76200acf4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:22.040474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-372d4c3d-7700-4302-bdd7-02b76200acf4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:22.176703 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-372d4c3d-7700-4302-bdd7-02b76200acf4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:22.184590 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-372d4c3d-7700-4302-bdd7-02b76200acf4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1359 microversion: 2.1 time: 0.163697 Jun 16 19:10:22.185556 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 590/1142] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:22 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:23.201839 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-ccfcca3f-e8e0-40c0-8012-d573e4e85ce2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:23.202465 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-ccfcca3f-e8e0-40c0-8012-d573e4e85ce2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:23.208921 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ccfcca3f-e8e0-40c0-8012-d573e4e85ce2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:23.209760 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ccfcca3f-e8e0-40c0-8012-d573e4e85ce2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:23.210772 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ccfcca3f-e8e0-40c0-8012-d573e4e85ce2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:23.211434 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-ccfcca3f-e8e0-40c0-8012-d573e4e85ce2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:23.348377 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-ccfcca3f-e8e0-40c0-8012-d573e4e85ce2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:23.356265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-ccfcca3f-e8e0-40c0-8012-d573e4e85ce2 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1359 microversion: 2.1 time: 0.158600 Jun 16 19:10:23.357461 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 553/1143] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:23 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:24.374508 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4942be05-5e05-4511-a0b2-57d7f3b8c559 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:24.375741 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4942be05-5e05-4511-a0b2-57d7f3b8c559 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:24.382354 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4942be05-5e05-4511-a0b2-57d7f3b8c559 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:24.382886 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4942be05-5e05-4511-a0b2-57d7f3b8c559 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:24.383734 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4942be05-5e05-4511-a0b2-57d7f3b8c559 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:24.384393 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4942be05-5e05-4511-a0b2-57d7f3b8c559 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:24.522361 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4942be05-5e05-4511-a0b2-57d7f3b8c559 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:24.530216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4942be05-5e05-4511-a0b2-57d7f3b8c559 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1359 microversion: 2.1 time: 0.160366 Jun 16 19:10:24.535632 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 591/1144] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:24 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:25.546394 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-1e5b2765-feb6-44a0-89b0-1ed34e74d849 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:25.547688 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-1e5b2765-feb6-44a0-89b0-1ed34e74d849 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:25.555117 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1e5b2765-feb6-44a0-89b0-1ed34e74d849 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:25.555564 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1e5b2765-feb6-44a0-89b0-1ed34e74d849 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:25.556457 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1e5b2765-feb6-44a0-89b0-1ed34e74d849 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:25.556896 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-1e5b2765-feb6-44a0-89b0-1ed34e74d849 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:25.695116 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-1e5b2765-feb6-44a0-89b0-1ed34e74d849 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:25.702750 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-1e5b2765-feb6-44a0-89b0-1ed34e74d849 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1359 microversion: 2.1 time: 0.160253 Jun 16 19:10:25.703597 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 554/1145] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:25 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:26.719751 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f0379227-b5b7-48d6-aa00-03b5400fc78d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:26.720353 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f0379227-b5b7-48d6-aa00-03b5400fc78d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:26.726628 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f0379227-b5b7-48d6-aa00-03b5400fc78d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:26.727069 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f0379227-b5b7-48d6-aa00-03b5400fc78d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:26.727828 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f0379227-b5b7-48d6-aa00-03b5400fc78d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:26.728263 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f0379227-b5b7-48d6-aa00-03b5400fc78d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:26.869099 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f0379227-b5b7-48d6-aa00-03b5400fc78d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:26.877819 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f0379227-b5b7-48d6-aa00-03b5400fc78d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1359 microversion: 2.1 time: 0.161781 Jun 16 19:10:26.887486 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 592/1146] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:26 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:27.895209 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9c880e94-1357-40ca-94b4-3a5a74fd186e tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:27.895772 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9c880e94-1357-40ca-94b4-3a5a74fd186e tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:27.898051 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:27.902919 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c880e94-1357-40ca-94b4-3a5a74fd186e tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:27.903360 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c880e94-1357-40ca-94b4-3a5a74fd186e tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:27.904125 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c880e94-1357-40ca-94b4-3a5a74fd186e tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:27.904560 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9c880e94-1357-40ca-94b4-3a5a74fd186e tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:28.035252 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-9c880e94-1357-40ca-94b4-3a5a74fd186e tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:28.044315 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9c880e94-1357-40ca-94b4-3a5a74fd186e tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1359 microversion: 2.1 time: 0.152630 Jun 16 19:10:28.044881 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 555/1147] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:27 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:10:29.042447 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-a768503d-716e-46a6-9400-eafbbc201e92 req-9a7d7156-8d5b-45e0-b019-9764e505de7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1348675e-c712-4fef-bfa2-055adc5e73b7", "tag": "efca7ecf-770c-43f6-ad48-76e41bcc8e51"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:29.047076 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell0:SELECT=6 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:29.052152 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-a768503d-716e-46a6-9400-eafbbc201e92 req-9a7d7156-8d5b-45e0-b019-9764e505de7b service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:29.052886 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-a768503d-716e-46a6-9400-eafbbc201e92 req-9a7d7156-8d5b-45e0-b019-9764e505de7b service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:29.063386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-13b09a08-bc13-4b58-89a3-c6b572891ff1 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:29.063386 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-13b09a08-bc13-4b58-89a3-c6b572891ff1 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:29.065505 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-a768503d-716e-46a6-9400-eafbbc201e92 req-9a7d7156-8d5b-45e0-b019-9764e505de7b service nova] Creating event network-changed:efca7ecf-770c-43f6-ad48-76e41bcc8e51 for instance 1348675e-c712-4fef-bfa2-055adc5e73b7 on hv-cinder-84617 Jun 16 19:10:29.071489 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-a768503d-716e-46a6-9400-eafbbc201e92 req-9a7d7156-8d5b-45e0-b019-9764e505de7b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033236 Jun 16 19:10:29.071723 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=8 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:29.072630 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 593/1148] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:10:29.073866 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-13b09a08-bc13-4b58-89a3-c6b572891ff1 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:29.074333 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-13b09a08-bc13-4b58-89a3-c6b572891ff1 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:29.076618 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-13b09a08-bc13-4b58-89a3-c6b572891ff1 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:29.077069 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-13b09a08-bc13-4b58-89a3-c6b572891ff1 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:29.540819 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-13b09a08-bc13-4b58-89a3-c6b572891ff1 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:29.548891 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-13b09a08-bc13-4b58-89a3-c6b572891ff1 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1359 microversion: 2.1 time: 0.491066 Jun 16 19:10:29.549500 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 556/1149] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:29 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1359 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:30.566592 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-1e48acf1-f15c-4401-bd83-a66ed07b13d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:30.567302 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-1e48acf1-f15c-4401-bd83-a66ed07b13d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:30.573615 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1e48acf1-f15c-4401-bd83-a66ed07b13d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:30.574595 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1e48acf1-f15c-4401-bd83-a66ed07b13d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:30.574828 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1e48acf1-f15c-4401-bd83-a66ed07b13d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:30.575774 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-1e48acf1-f15c-4401-bd83-a66ed07b13d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:30.707550 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-1e48acf1-f15c-4401-bd83-a66ed07b13d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:30.714935 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-1e48acf1-f15c-4401-bd83-a66ed07b13d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1359 microversion: 2.1 time: 0.153537 Jun 16 19:10:30.715719 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 594/1150] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:30 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:31.734025 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-2bf3144b-f41c-44e7-89e7-a68db8915eb4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:31.734568 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-2bf3144b-f41c-44e7-89e7-a68db8915eb4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:31.741098 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2bf3144b-f41c-44e7-89e7-a68db8915eb4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:31.741571 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2bf3144b-f41c-44e7-89e7-a68db8915eb4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:31.742322 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2bf3144b-f41c-44e7-89e7-a68db8915eb4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:31.742781 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-2bf3144b-f41c-44e7-89e7-a68db8915eb4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:31.870214 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-2bf3144b-f41c-44e7-89e7-a68db8915eb4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:31.877930 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-2bf3144b-f41c-44e7-89e7-a68db8915eb4 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1359 microversion: 2.1 time: 0.147719 Jun 16 19:10:31.878491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 557/1151] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:31 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:32.894764 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-cda82c21-9e7f-4f93-a8c9-8c445c34425a tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:32.895337 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-cda82c21-9e7f-4f93-a8c9-8c445c34425a tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:32.901875 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cda82c21-9e7f-4f93-a8c9-8c445c34425a tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:32.902327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cda82c21-9e7f-4f93-a8c9-8c445c34425a tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:32.903092 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cda82c21-9e7f-4f93-a8c9-8c445c34425a tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:32.903534 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cda82c21-9e7f-4f93-a8c9-8c445c34425a tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:33.028166 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cda82c21-9e7f-4f93-a8c9-8c445c34425a tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:33.035999 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-cda82c21-9e7f-4f93-a8c9-8c445c34425a tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1359 microversion: 2.1 time: 0.145259 Jun 16 19:10:33.036560 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 595/1152] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:32 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:34.052748 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-e466215c-5b4e-4ab4-acae-883e9837afbd tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:34.053397 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-e466215c-5b4e-4ab4-acae-883e9837afbd tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:34.059861 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e466215c-5b4e-4ab4-acae-883e9837afbd tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:34.060315 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e466215c-5b4e-4ab4-acae-883e9837afbd tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:34.061690 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e466215c-5b4e-4ab4-acae-883e9837afbd tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:34.062127 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-e466215c-5b4e-4ab4-acae-883e9837afbd tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:34.190224 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-e466215c-5b4e-4ab4-acae-883e9837afbd tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:34.197849 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-e466215c-5b4e-4ab4-acae-883e9837afbd tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1359 microversion: 2.1 time: 0.149098 Jun 16 19:10:34.203726 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 558/1153] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:34 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:35.214523 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-cfbcfecc-b3a9-40d6-8363-eb7d36663696 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:35.215138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-cfbcfecc-b3a9-40d6-8363-eb7d36663696 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:35.222136 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cfbcfecc-b3a9-40d6-8363-eb7d36663696 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:35.222584 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cfbcfecc-b3a9-40d6-8363-eb7d36663696 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:35.223343 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cfbcfecc-b3a9-40d6-8363-eb7d36663696 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:35.223913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cfbcfecc-b3a9-40d6-8363-eb7d36663696 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:35.352260 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cfbcfecc-b3a9-40d6-8363-eb7d36663696 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:35.360216 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-cfbcfecc-b3a9-40d6-8363-eb7d36663696 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1359 microversion: 2.1 time: 0.149617 Jun 16 19:10:35.360783 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 596/1154] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:35 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:36.050454 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-40ff6e5a-4741-47c6-99ac-3bc81ef7aa17 req-3b3ab7f1-bf76-412c-8e4a-cf8f16277b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1348675e-c712-4fef-bfa2-055adc5e73b7", "name": "network-vif-plugged", "status": "completed", "tag": "efca7ecf-770c-43f6-ad48-76e41bcc8e51"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:36.059114 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-40ff6e5a-4741-47c6-99ac-3bc81ef7aa17 req-3b3ab7f1-bf76-412c-8e4a-cf8f16277b91 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:36.059551 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-40ff6e5a-4741-47c6-99ac-3bc81ef7aa17 req-3b3ab7f1-bf76-412c-8e4a-cf8f16277b91 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:36.070368 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-40ff6e5a-4741-47c6-99ac-3bc81ef7aa17 req-3b3ab7f1-bf76-412c-8e4a-cf8f16277b91 service nova] Creating event network-vif-plugged:efca7ecf-770c-43f6-ad48-76e41bcc8e51 for instance 1348675e-c712-4fef-bfa2-055adc5e73b7 on hv-cinder-84617 Jun 16 19:10:36.075457 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-40ff6e5a-4741-47c6-99ac-3bc81ef7aa17 req-3b3ab7f1-bf76-412c-8e4a-cf8f16277b91 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029286 Jun 16 19:10:36.076039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 559/1155] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:10:36.378138 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d1d8a6fc-e44d-4293-b7cf-66e4d69374ce tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:36.378901 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d1d8a6fc-e44d-4293-b7cf-66e4d69374ce tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:36.385733 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d1d8a6fc-e44d-4293-b7cf-66e4d69374ce tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:36.385959 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d1d8a6fc-e44d-4293-b7cf-66e4d69374ce tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:36.386732 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d1d8a6fc-e44d-4293-b7cf-66e4d69374ce tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:36.387171 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d1d8a6fc-e44d-4293-b7cf-66e4d69374ce tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:36.541716 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d1d8a6fc-e44d-4293-b7cf-66e4d69374ce tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:36.549024 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d1d8a6fc-e44d-4293-b7cf-66e4d69374ce tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1359 microversion: 2.1 time: 0.175629 Jun 16 19:10:36.549603 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 597/1156] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:36 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:37.566419 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-29d632a5-5874-4056-8d14-50a23d4b3af7 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:37.567122 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-29d632a5-5874-4056-8d14-50a23d4b3af7 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:37.573279 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29d632a5-5874-4056-8d14-50a23d4b3af7 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:37.573732 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29d632a5-5874-4056-8d14-50a23d4b3af7 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:37.574493 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29d632a5-5874-4056-8d14-50a23d4b3af7 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:37.574936 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-29d632a5-5874-4056-8d14-50a23d4b3af7 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:37.703061 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-29d632a5-5874-4056-8d14-50a23d4b3af7 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:37.710461 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-29d632a5-5874-4056-8d14-50a23d4b3af7 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1549 microversion: 2.1 time: 0.148699 Jun 16 19:10:37.711018 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 560/1157] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:37 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:37.726809 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4723544b-ae09-444b-ac91-92d38d38682d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:37.727416 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4723544b-ae09-444b-ac91-92d38d38682d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:37.733860 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4723544b-ae09-444b-ac91-92d38d38682d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:37.734310 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4723544b-ae09-444b-ac91-92d38d38682d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:37.735057 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4723544b-ae09-444b-ac91-92d38d38682d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:37.735483 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4723544b-ae09-444b-ac91-92d38d38682d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:37.867371 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4723544b-ae09-444b-ac91-92d38d38682d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:37.875327 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4723544b-ae09-444b-ac91-92d38d38682d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1549 microversion: 2.1 time: 0.152279 Jun 16 19:10:37.875890 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 598/1158] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:37 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:37.891272 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4dd0c345-3fd0-41b3-b3a0-6be1c489ae25 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:37.894723 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-4dd0c345-3fd0-41b3-b3a0-6be1c489ae25 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:37.895516 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4dd0c345-3fd0-41b3-b3a0-6be1c489ae25 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Searching by: {'deleted': False, 'project_id': '434965eee025410ca595f90a8bd80ee5'} {{(pid=130230) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 19:10:37.902492 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4dd0c345-3fd0-41b3-b3a0-6be1c489ae25 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:37.902877 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4dd0c345-3fd0-41b3-b3a0-6be1c489ae25 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:37.903672 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4dd0c345-3fd0-41b3-b3a0-6be1c489ae25 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:37.904107 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4dd0c345-3fd0-41b3-b3a0-6be1c489ae25 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:37.993996 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.multi_cell_list [None req-4dd0c345-3fd0-41b3-b3a0-6be1c489ae25 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130230) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 19:10:38.086191 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4dd0c345-3fd0-41b3-b3a0-6be1c489ae25 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199083 Jun 16 19:10:38.086774 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 561/1159] 10.222.0.81 () {58 vars in 1124 bytes} [Thu Jun 16 19:10:37 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:10:38.096790 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-0a2ecd3e-ffe1-4d04-b30c-b59895693b7f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:38.097669 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-0a2ecd3e-ffe1-4d04-b30c-b59895693b7f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:38.103619 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a2ecd3e-ffe1-4d04-b30c-b59895693b7f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:38.104123 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a2ecd3e-ffe1-4d04-b30c-b59895693b7f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:38.104893 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a2ecd3e-ffe1-4d04-b30c-b59895693b7f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:38.105358 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-0a2ecd3e-ffe1-4d04-b30c-b59895693b7f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:38.233402 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-0a2ecd3e-ffe1-4d04-b30c-b59895693b7f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:38.240857 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-0a2ecd3e-ffe1-4d04-b30c-b59895693b7f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1549 microversion: 2.1 time: 0.147936 Jun 16 19:10:38.241462 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 599/1160] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:38 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:40.027159 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-3689c71c-481a-4ea8-9395-a974a0f99717 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea5695ad-e9ea-4031-a2ef-2f568200b0cd"}} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:40.028228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-3689c71c-481a-4ea8-9395-a974a0f99717 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:40.035363 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3689c71c-481a-4ea8-9395-a974a0f99717 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:40.035813 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3689c71c-481a-4ea8-9395-a974a0f99717 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:40.036569 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3689c71c-481a-4ea8-9395-a974a0f99717 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:40.037004 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-3689c71c-481a-4ea8-9395-a974a0f99717 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:40.752621 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-3689c71c-481a-4ea8-9395-a974a0f99717 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "POST /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.729202 Jun 16 19:10:40.753285 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 562/1161] 10.222.0.81 () {60 vars in 1322 bytes} [Thu Jun 16 19:10:40 2022] POST /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/os-volume_attachments => generated 194 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:10:48.286773 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4834c7f2-1892-4f57-9e21-6fc76c88e197 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:48.287387 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4834c7f2-1892-4f57-9e21-6fc76c88e197 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:48.290032 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:48.290679 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=62 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:48.295913 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4834c7f2-1892-4f57-9e21-6fc76c88e197 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:48.300256 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4834c7f2-1892-4f57-9e21-6fc76c88e197 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:48.300256 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4834c7f2-1892-4f57-9e21-6fc76c88e197 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:48.300256 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4834c7f2-1892-4f57-9e21-6fc76c88e197 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:48.426713 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-4834c7f2-1892-4f57-9e21-6fc76c88e197 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:48.433520 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4834c7f2-1892-4f57-9e21-6fc76c88e197 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1595 microversion: 2.1 time: 0.150560 Jun 16 19:10:48.434084 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 600/1162] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:48 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1595 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:50.571801 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell0:SELECT=2 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:50.572726 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:50.687248 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:50.720869 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-b38e40c9-d086-45fc-8d76-07e3bdbf66ee req-7ecc3ee8-ef56-44f0-8e49-a5953df205f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1348675e-c712-4fef-bfa2-055adc5e73b7", "tag": "efca7ecf-770c-43f6-ad48-76e41bcc8e51"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:50.729795 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-b38e40c9-d086-45fc-8d76-07e3bdbf66ee req-7ecc3ee8-ef56-44f0-8e49-a5953df205f7 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:50.730374 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-b38e40c9-d086-45fc-8d76-07e3bdbf66ee req-7ecc3ee8-ef56-44f0-8e49-a5953df205f7 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:50.743771 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-b38e40c9-d086-45fc-8d76-07e3bdbf66ee req-7ecc3ee8-ef56-44f0-8e49-a5953df205f7 service nova] Creating event network-changed:efca7ecf-770c-43f6-ad48-76e41bcc8e51 for instance 1348675e-c712-4fef-bfa2-055adc5e73b7 on hv-cinder-84617 Jun 16 19:10:50.749661 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-b38e40c9-d086-45fc-8d76-07e3bdbf66ee req-7ecc3ee8-ef56-44f0-8e49-a5953df205f7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179268 Jun 16 19:10:50.750264 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 563/1163] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:10:53.067092 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-4d418f55-d6b7-4ec2-803f-8c290563a04d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1542838325"}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:53.067639 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-4d418f55-d6b7-4ec2-803f-8c290563a04d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:53.074379 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d418f55-d6b7-4ec2-803f-8c290563a04d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:53.078099 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d418f55-d6b7-4ec2-803f-8c290563a04d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:53.078099 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d418f55-d6b7-4ec2-803f-8c290563a04d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:53.078099 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-4d418f55-d6b7-4ec2-803f-8c290563a04d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:53.202582 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.network.security_group_api [None req-4d418f55-d6b7-4ec2-803f-8c290563a04d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Adding security group bedae7e7-5372-4bfa-b109-7cae6446e1e5 to port efca7ecf-770c-43f6-ad48-76e41bcc8e51 Jun 16 19:10:53.618964 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-4d418f55-d6b7-4ec2-803f-8c290563a04d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "POST /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/action" status: 202 len: 0 microversion: 2.1 time: 0.555716 Jun 16 19:10:53.621025 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 601/1164] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jun 16 19:10:53 2022] POST /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:10:53.630436 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-55b5330b-95f4-47df-8d50-ad3eac343e1d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:53.631292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-55b5330b-95f4-47df-8d50-ad3eac343e1d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:53.631872 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [req-5e320d6a-e06f-4d6d-a995-2400c01d21b3 req-08f09438-c5ec-4971-adc6-0e1a58563526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1348675e-c712-4fef-bfa2-055adc5e73b7", "tag": "efca7ecf-770c-43f6-ad48-76e41bcc8e51"}]} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:53.643382 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-55b5330b-95f4-47df-8d50-ad3eac343e1d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:53.643382 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-55b5330b-95f4-47df-8d50-ad3eac343e1d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:53.643382 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-55b5330b-95f4-47df-8d50-ad3eac343e1d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:53.643382 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-55b5330b-95f4-47df-8d50-ad3eac343e1d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:53.651172 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-5e320d6a-e06f-4d6d-a995-2400c01d21b3 req-08f09438-c5ec-4971-adc6-0e1a58563526 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:53.659483 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [req-5e320d6a-e06f-4d6d-a995-2400c01d21b3 req-08f09438-c5ec-4971-adc6-0e1a58563526 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:53.676724 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.compute.server_external_events [req-5e320d6a-e06f-4d6d-a995-2400c01d21b3 req-08f09438-c5ec-4971-adc6-0e1a58563526 service nova] Creating event network-changed:efca7ecf-770c-43f6-ad48-76e41bcc8e51 for instance 1348675e-c712-4fef-bfa2-055adc5e73b7 on hv-cinder-84617 Jun 16 19:10:53.683504 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [req-5e320d6a-e06f-4d6d-a995-2400c01d21b3 req-08f09438-c5ec-4971-adc6-0e1a58563526 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057283 Jun 16 19:10:53.684661 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 602/1165] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:10:53.921333 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-55b5330b-95f4-47df-8d50-ad3eac343e1d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:53.929993 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-55b5330b-95f4-47df-8d50-ad3eac343e1d tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1761 microversion: 2.1 time: 0.303987 Jun 16 19:10:53.941672 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 564/1166] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:53 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1761 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:59.869835 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:10:59.870556 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Thu Jun 16 19:10:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:11:10.884295 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-23734878-5e46-47d9-a903-8e38aa9b1c02 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:10.885258 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-23734878-5e46-47d9-a903-8e38aa9b1c02 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:10.887403 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=6 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:10.888044 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=12 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:10.892837 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-23734878-5e46-47d9-a903-8e38aa9b1c02 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:10.893299 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-23734878-5e46-47d9-a903-8e38aa9b1c02 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:10.894052 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-23734878-5e46-47d9-a903-8e38aa9b1c02 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:10.894480 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-23734878-5e46-47d9-a903-8e38aa9b1c02 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:11.095782 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-23734878-5e46-47d9-a903-8e38aa9b1c02 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "POST /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/action" status: 202 len: 0 microversion: 2.1 time: 0.215857 Jun 16 19:11:11.096410 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 603/1167] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jun 16 19:11:10 2022] POST /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:11:11.112791 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-287830a0-fb34-4066-b758-81645645265c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:11.113623 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-287830a0-fb34-4066-b758-81645645265c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:11.116039 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=4 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:11.116690 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=8 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:11.121414 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-287830a0-fb34-4066-b758-81645645265c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:11.121869 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-287830a0-fb34-4066-b758-81645645265c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:11.122638 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-287830a0-fb34-4066-b758-81645645265c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:11.123112 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-287830a0-fb34-4066-b758-81645645265c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:11.410413 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-287830a0-fb34-4066-b758-81645645265c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:11.418310 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-287830a0-fb34-4066-b758-81645645265c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1753 microversion: 2.1 time: 0.309363 Jun 16 19:11:11.418882 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 565/1168] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:11 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1753 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:12.437802 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-95b92fc1-56ae-4d08-abd5-eef7abbf2728 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:12.438533 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-95b92fc1-56ae-4d08-abd5-eef7abbf2728 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:12.444757 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-95b92fc1-56ae-4d08-abd5-eef7abbf2728 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:12.445229 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-95b92fc1-56ae-4d08-abd5-eef7abbf2728 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:12.446021 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-95b92fc1-56ae-4d08-abd5-eef7abbf2728 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:12.446460 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-95b92fc1-56ae-4d08-abd5-eef7abbf2728 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:12.636237 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-95b92fc1-56ae-4d08-abd5-eef7abbf2728 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:12.644185 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-95b92fc1-56ae-4d08-abd5-eef7abbf2728 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1758 microversion: 2.1 time: 0.211805 Jun 16 19:11:12.644749 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 604/1169] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:12 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1758 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:13.661533 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-8e233d5c-93aa-41e6-b991-c29a600a1779 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:13.662074 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-8e233d5c-93aa-41e6-b991-c29a600a1779 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:13.668506 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8e233d5c-93aa-41e6-b991-c29a600a1779 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:13.668949 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8e233d5c-93aa-41e6-b991-c29a600a1779 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:13.669731 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8e233d5c-93aa-41e6-b991-c29a600a1779 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:13.670778 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-8e233d5c-93aa-41e6-b991-c29a600a1779 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:13.811361 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-8e233d5c-93aa-41e6-b991-c29a600a1779 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:13.819222 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-8e233d5c-93aa-41e6-b991-c29a600a1779 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1758 microversion: 2.1 time: 0.161648 Jun 16 19:11:13.819785 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 566/1170] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:13 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:14.836734 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-cf0a1c32-ce25-4df0-ac3c-fe8da4ce74ff tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:14.837380 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-cf0a1c32-ce25-4df0-ac3c-fe8da4ce74ff tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:14.844332 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cf0a1c32-ce25-4df0-ac3c-fe8da4ce74ff tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:14.848610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cf0a1c32-ce25-4df0-ac3c-fe8da4ce74ff tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:14.848610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cf0a1c32-ce25-4df0-ac3c-fe8da4ce74ff tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:14.848610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-cf0a1c32-ce25-4df0-ac3c-fe8da4ce74ff tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:14.986106 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-cf0a1c32-ce25-4df0-ac3c-fe8da4ce74ff tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:14.993985 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-cf0a1c32-ce25-4df0-ac3c-fe8da4ce74ff tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1758 microversion: 2.1 time: 0.161137 Jun 16 19:11:14.994546 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 605/1171] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:14 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:16.011265 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-349b23c8-7862-4525-849e-5fa621b548f5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:16.011877 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-349b23c8-7862-4525-849e-5fa621b548f5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:16.018891 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-349b23c8-7862-4525-849e-5fa621b548f5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:16.019337 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-349b23c8-7862-4525-849e-5fa621b548f5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:16.020099 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-349b23c8-7862-4525-849e-5fa621b548f5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:16.020534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-349b23c8-7862-4525-849e-5fa621b548f5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:16.160758 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-349b23c8-7862-4525-849e-5fa621b548f5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:16.168534 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-349b23c8-7862-4525-849e-5fa621b548f5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1758 microversion: 2.1 time: 0.161265 Jun 16 19:11:16.169093 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 567/1172] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:16 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:17.186428 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-71de11d6-d8b5-42ea-9e5a-93d27bc8c455 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:17.187077 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-71de11d6-d8b5-42ea-9e5a-93d27bc8c455 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:17.193602 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-71de11d6-d8b5-42ea-9e5a-93d27bc8c455 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:17.194053 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-71de11d6-d8b5-42ea-9e5a-93d27bc8c455 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:17.194816 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-71de11d6-d8b5-42ea-9e5a-93d27bc8c455 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:17.195253 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-71de11d6-d8b5-42ea-9e5a-93d27bc8c455 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:17.334291 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-71de11d6-d8b5-42ea-9e5a-93d27bc8c455 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:17.342363 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-71de11d6-d8b5-42ea-9e5a-93d27bc8c455 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1758 microversion: 2.1 time: 0.160284 Jun 16 19:11:17.342933 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 606/1173] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:17 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:18.360164 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-b537b6d1-0baf-4e26-b307-e1cd4cfc347c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:18.360776 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-b537b6d1-0baf-4e26-b307-e1cd4cfc347c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:18.367226 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b537b6d1-0baf-4e26-b307-e1cd4cfc347c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:18.367669 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b537b6d1-0baf-4e26-b307-e1cd4cfc347c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:18.368423 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b537b6d1-0baf-4e26-b307-e1cd4cfc347c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:18.368855 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-b537b6d1-0baf-4e26-b307-e1cd4cfc347c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:18.508362 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-b537b6d1-0baf-4e26-b307-e1cd4cfc347c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:18.516317 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-b537b6d1-0baf-4e26-b307-e1cd4cfc347c tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1758 microversion: 2.1 time: 0.160643 Jun 16 19:11:18.516881 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 568/1174] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:18 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:19.533751 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-f0a2c74d-3ed6-4741-bacd-c19233317142 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:19.534485 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-f0a2c74d-3ed6-4741-bacd-c19233317142 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:19.540880 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f0a2c74d-3ed6-4741-bacd-c19233317142 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:19.541365 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f0a2c74d-3ed6-4741-bacd-c19233317142 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:19.542124 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f0a2c74d-3ed6-4741-bacd-c19233317142 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:19.542559 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-f0a2c74d-3ed6-4741-bacd-c19233317142 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:19.680401 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-f0a2c74d-3ed6-4741-bacd-c19233317142 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:19.688781 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-f0a2c74d-3ed6-4741-bacd-c19233317142 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1758 microversion: 2.1 time: 0.159620 Jun 16 19:11:19.689419 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 607/1175] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:19 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:20.705891 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-d401d2ea-c890-41f9-ac24-e4e083e5227f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:20.706491 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-d401d2ea-c890-41f9-ac24-e4e083e5227f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:20.713015 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d401d2ea-c890-41f9-ac24-e4e083e5227f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:20.713447 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d401d2ea-c890-41f9-ac24-e4e083e5227f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:20.714212 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d401d2ea-c890-41f9-ac24-e4e083e5227f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:20.714651 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-d401d2ea-c890-41f9-ac24-e4e083e5227f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:20.853416 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-d401d2ea-c890-41f9-ac24-e4e083e5227f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:20.861325 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-d401d2ea-c890-41f9-ac24-e4e083e5227f tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1758 microversion: 2.1 time: 0.159203 Jun 16 19:11:20.861887 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 569/1176] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:20 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:21.883899 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-11343263-3c84-4b06-a313-07010dd99660 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:21.884509 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-11343263-3c84-4b06-a313-07010dd99660 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:21.891079 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-11343263-3c84-4b06-a313-07010dd99660 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:21.891522 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-11343263-3c84-4b06-a313-07010dd99660 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:21.892276 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-11343263-3c84-4b06-a313-07010dd99660 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:21.892729 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-11343263-3c84-4b06-a313-07010dd99660 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:22.033085 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-11343263-3c84-4b06-a313-07010dd99660 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:22.041043 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-11343263-3c84-4b06-a313-07010dd99660 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1758 microversion: 2.1 time: 0.161005 Jun 16 19:11:22.041631 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 608/1177] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:21 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:23.062865 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-bee81682-88db-4530-8fd3-733d89e0bbef tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:23.063864 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-bee81682-88db-4530-8fd3-733d89e0bbef tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:23.070204 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bee81682-88db-4530-8fd3-733d89e0bbef tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:23.070651 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bee81682-88db-4530-8fd3-733d89e0bbef tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:23.071425 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bee81682-88db-4530-8fd3-733d89e0bbef tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:23.071860 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-bee81682-88db-4530-8fd3-733d89e0bbef tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:23.217650 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-bee81682-88db-4530-8fd3-733d89e0bbef tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:23.225535 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-bee81682-88db-4530-8fd3-733d89e0bbef tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1761 microversion: 2.1 time: 0.170096 Jun 16 19:11:23.226161 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 570/1178] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:23 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1761 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:55.456952 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-ce7ce7f1-8028-47e1-b513-8caa35fb7ff5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1542838325"}} {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:55.457521 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-ce7ce7f1-8028-47e1-b513-8caa35fb7ff5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:55.459765 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_api:SELECT=12 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:55.460552 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG dbcounter [-] [130229] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130229) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:55.465081 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ce7ce7f1-8028-47e1-b513-8caa35fb7ff5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:55.465557 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ce7ce7f1-8028-47e1-b513-8caa35fb7ff5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:55.466310 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ce7ce7f1-8028-47e1-b513-8caa35fb7ff5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:55.466746 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-ce7ce7f1-8028-47e1-b513-8caa35fb7ff5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:55.835743 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.network.security_group_api [None req-ce7ce7f1-8028-47e1-b513-8caa35fb7ff5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Removing security group bedae7e7-5372-4bfa-b109-7cae6446e1e5 from port efca7ecf-770c-43f6-ad48-76e41bcc8e51 Jun 16 19:11:56.212610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-ce7ce7f1-8028-47e1-b513-8caa35fb7ff5 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "POST /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/action" status: 202 len: 0 microversion: 2.1 time: 0.753500 Jun 16 19:11:56.212610 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 609/1179] 10.222.0.81 () {60 vars in 1277 bytes} [Thu Jun 16 19:11:55 2022] POST /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/action => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:11:56.220041 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_api:SELECT=12 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:56.222096 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG dbcounter [-] [130230] Writing DB stats nova_cell1:SELECT=36 {{(pid=130230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:56.348994 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-1340f109-3b6e-4384-a835-6f5b246bd5fd req-e46e77f4-a73f-4c2b-9164-b851fe5df578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1348675e-c712-4fef-bfa2-055adc5e73b7", "tag": "efca7ecf-770c-43f6-ad48-76e41bcc8e51"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:56.367124 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-1340f109-3b6e-4384-a835-6f5b246bd5fd req-e46e77f4-a73f-4c2b-9164-b851fe5df578 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:56.367596 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-1340f109-3b6e-4384-a835-6f5b246bd5fd req-e46e77f4-a73f-4c2b-9164-b851fe5df578 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:56.382403 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-1340f109-3b6e-4384-a835-6f5b246bd5fd req-e46e77f4-a73f-4c2b-9164-b851fe5df578 service nova] Creating event network-changed:efca7ecf-770c-43f6-ad48-76e41bcc8e51 for instance 1348675e-c712-4fef-bfa2-055adc5e73b7 on hv-cinder-84617 Jun 16 19:11:56.388692 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-1340f109-3b6e-4384-a835-6f5b246bd5fd req-e46e77f4-a73f-4c2b-9164-b851fe5df578 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174005 Jun 16 19:11:56.389753 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 571/1180] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:57.465162 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-df47bd42-d36d-4a93-9f6e-48d87bf4f0d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:57.465714 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-df47bd42-d36d-4a93-9f6e-48d87bf4f0d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:57.472257 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-df47bd42-d36d-4a93-9f6e-48d87bf4f0d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:57.472722 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-df47bd42-d36d-4a93-9f6e-48d87bf4f0d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:57.473519 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-df47bd42-d36d-4a93-9f6e-48d87bf4f0d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:57.473957 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-df47bd42-d36d-4a93-9f6e-48d87bf4f0d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:57.474332 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-125fd6b2-034c-437f-afe4-f352cf7aab96 req-46ded975-75b9-478e-a8cd-2ff31c93e77d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1348675e-c712-4fef-bfa2-055adc5e73b7", "tag": "efca7ecf-770c-43f6-ad48-76e41bcc8e51"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:57.483033 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-125fd6b2-034c-437f-afe4-f352cf7aab96 req-46ded975-75b9-478e-a8cd-2ff31c93e77d service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:57.483482 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-125fd6b2-034c-437f-afe4-f352cf7aab96 req-46ded975-75b9-478e-a8cd-2ff31c93e77d service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:57.494644 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-125fd6b2-034c-437f-afe4-f352cf7aab96 req-46ded975-75b9-478e-a8cd-2ff31c93e77d service nova] Creating event network-changed:efca7ecf-770c-43f6-ad48-76e41bcc8e51 for instance 1348675e-c712-4fef-bfa2-055adc5e73b7 on hv-cinder-84617 Jun 16 19:11:57.499965 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-125fd6b2-034c-437f-afe4-f352cf7aab96 req-46ded975-75b9-478e-a8cd-2ff31c93e77d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029600 Jun 16 19:11:57.500820 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 572/1181] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:57.564112 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.objects.instance [None req-df47bd42-d36d-4a93-9f6e-48d87bf4f0d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lazy-loading 'services' on Instance uuid 1348675e-c712-4fef-bfa2-055adc5e73b7 {{(pid=130229) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:11:58.024979 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-df47bd42-d36d-4a93-9f6e-48d87bf4f0d6 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/os-volume_attachments/ea5695ad-e9ea-4031-a2ef-2f568200b0cd" status: 202 len: 0 microversion: 2.1 time: 0.563772 Jun 16 19:11:58.026094 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 610/1182] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jun 16 19:11:57 2022] DELETE /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/os-volume_attachments/ea5695ad-e9ea-4031-a2ef-2f568200b0cd => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:11:58.036324 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-4c57b3bd-24d9-474b-b0f0-298ad61aeb63 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:58.037659 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-4c57b3bd-24d9-474b-b0f0-298ad61aeb63 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:58.044248 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c57b3bd-24d9-474b-b0f0-298ad61aeb63 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:58.044828 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c57b3bd-24d9-474b-b0f0-298ad61aeb63 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:58.045729 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c57b3bd-24d9-474b-b0f0-298ad61aeb63 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:58.047001 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-4c57b3bd-24d9-474b-b0f0-298ad61aeb63 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:58.076393 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-4c57b3bd-24d9-474b-b0f0-298ad61aeb63 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044616 Jun 16 19:11:58.076952 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 573/1183] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:11:58 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:59.088732 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-b5ed2511-adce-49fa-b39e-10fd60288956 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:59.089889 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-b5ed2511-adce-49fa-b39e-10fd60288956 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:59.097183 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5ed2511-adce-49fa-b39e-10fd60288956 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:59.097664 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5ed2511-adce-49fa-b39e-10fd60288956 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:59.098474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5ed2511-adce-49fa-b39e-10fd60288956 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:59.098907 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-b5ed2511-adce-49fa-b39e-10fd60288956 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:59.128892 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-b5ed2511-adce-49fa-b39e-10fd60288956 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044554 Jun 16 19:11:59.129470 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 611/1184] 10.222.0.81 () {58 vars in 1301 bytes} [Thu Jun 16 19:11:59 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:11:59.139376 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9862e069-c5fc-472f-be35-0edc0af5a1d8 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:59.141974 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-9862e069-c5fc-472f-be35-0edc0af5a1d8 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:59.146889 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9862e069-c5fc-472f-be35-0edc0af5a1d8 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:59.147396 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9862e069-c5fc-472f-be35-0edc0af5a1d8 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:59.148162 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9862e069-c5fc-472f-be35-0edc0af5a1d8 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:59.148597 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-9862e069-c5fc-472f-be35-0edc0af5a1d8 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:59.222176 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-9862e069-c5fc-472f-be35-0edc0af5a1d8 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] HTTP exception thrown: Instance 1348675e-c712-4fef-bfa2-055adc5e73b7 is not attached to volume ea5695ad-e9ea-4031-a2ef-2f568200b0cd Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9862e069-c5fc-472f-be35-0edc0af5a1d8 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Request method failure captured: Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: DELETE /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/os-volume_attachments/ea5695ad-e9ea-4031-a2ef-2f568200b0cd HTTP/1.1 Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq4AH-Q_7nfgUMvsVHgg5ReNAsRcKc8Qnifkq_1Aaw89BWY-1T0Wif_6B9z18Qv4XGD2Of3Nhk2yCUD_mTc3xYZeCubbtFl4hjYZjPX4wK6nzMef5pWzSFCrNwQ-kPhPCg453uxEioUfNpZxXYcAC-psYduMYYRZrdNuABDnOWu2rn6A Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: 434965eee025410ca595f90a8bd80ee5 Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-TestMinimumBasicScenario-403167475 Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:11:59.224566 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:11:59.226458 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/434965eee025410ca595f90a8bd80ee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_434965eee025410ca595f90a8bd80ee5", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/434965eee025410ca595f90a8bd80ee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/434965eee025410ca595f90a8bd80ee5"}]}] Jun 16 19:11:59.226458 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-TestMinimumBasicScenario-403167475 Jun 16 19:11:59.226458 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: 434965eee025410ca595f90a8bd80ee5 Jun 16 19:11:59.226458 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-TestMinimumBasicScenario-403167475 Jun 16 19:11:59.226458 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-TestMinimumBasicScenario-403167475-project Jun 16 19:11:59.226458 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:11:59.226458 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:11:59.226458 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: a52eccb2ea4b4920863f4e74e75296ab Jun 16 19:11:59.226458 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-TestMinimumBasicScenario-403167475-project Jun 16 19:11:59.226458 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:11:59.226458 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance 1348675e-c712-4fef-bfa2-055adc5e73b7 is not attached to volume ea5695ad-e9ea-4031-a2ef-2f568200b0cd Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'server_id': '1348675e-c712-4fef-bfa2-055adc5e73b7', 'id': 'ea5695ad-e9ea-4031-a2ef-2f568200b0cd'} Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ea5695ad-e9ea-4031-a2ef-2f568200b0cd. Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:11:59.227639 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:11:59.229319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:11:59.229319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 19:11:59.229319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 19:11:59.229319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1348675e-c712-4fef-bfa2-055adc5e73b7 is not attached to volume ea5695ad-e9ea-4031-a2ef-2f568200b0cd Jun 16 19:11:59.229319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:11:59.229319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:11:59.229319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:11:59.229319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:11:59.229319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:11:59.229319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:11:59.229319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:11:59.229319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:11:59.229319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1348675e-c712-4fef-bfa2-055adc5e73b7 is not attached to volume ea5695ad-e9ea-4031-a2ef-2f568200b0cd Jun 16 19:11:59.229319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:11:59.229319 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-9862e069-c5fc-472f-be35-0edc0af5a1d8 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Returning 404 to user: Instance 1348675e-c712-4fef-bfa2-055adc5e73b7 is not attached to volume ea5695ad-e9ea-4031-a2ef-2f568200b0cd {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:11:59.230723 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-9862e069-c5fc-472f-be35-0edc0af5a1d8 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/os-volume_attachments/ea5695ad-e9ea-4031-a2ef-2f568200b0cd" status: 404 len: 154 microversion: 2.1 time: 0.090736 Jun 16 19:11:59.230723 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 574/1185] 10.222.0.81 () {58 vars in 1415 bytes} [Thu Jun 16 19:11:59 2022] DELETE /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7/os-volume_attachments/ea5695ad-e9ea-4031-a2ef-2f568200b0cd => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:12:00.496440 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-c47ab81b-c6fb-47ca-9476-47b88edc27c0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:00.496941 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c47ab81b-c6fb-47ca-9476-47b88edc27c0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:00.504007 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c47ab81b-c6fb-47ca-9476-47b88edc27c0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:00.504447 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c47ab81b-c6fb-47ca-9476-47b88edc27c0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:00.505196 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c47ab81b-c6fb-47ca-9476-47b88edc27c0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:00.505645 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-c47ab81b-c6fb-47ca-9476-47b88edc27c0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:00.530673 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-c47ab81b-c6fb-47ca-9476-47b88edc27c0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Going to try to terminate instance {{(pid=130229) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:12:00.793063 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-c47ab81b-c6fb-47ca-9476-47b88edc27c0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "DELETE /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 204 len: 0 microversion: 2.1 time: 0.300231 Jun 16 19:12:00.793605 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 612/1186] 10.222.0.81 () {58 vars in 1238 bytes} [Thu Jun 16 19:12:00 2022] DELETE /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:12:00.802106 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-6d55690c-1159-4a61-92d0-83a58ef3c5ab tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:00.802871 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-6d55690c-1159-4a61-92d0-83a58ef3c5ab tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:00.809423 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d55690c-1159-4a61-92d0-83a58ef3c5ab tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:00.809876 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d55690c-1159-4a61-92d0-83a58ef3c5ab tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:00.810647 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d55690c-1159-4a61-92d0-83a58ef3c5ab tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:00.811114 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-6d55690c-1159-4a61-92d0-83a58ef3c5ab tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:00.941850 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.policy [None req-6d55690c-1159-4a61-92d0-83a58ef3c5ab tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130230) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:00.952685 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-6d55690c-1159-4a61-92d0-83a58ef3c5ab tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1555 microversion: 2.1 time: 0.154382 Jun 16 19:12:00.953280 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 575/1187] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:00 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:01.970474 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-8a55be2b-98fe-4201-be4f-0671e6b89614 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:01.971204 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-8a55be2b-98fe-4201-be4f-0671e6b89614 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:01.977669 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8a55be2b-98fe-4201-be4f-0671e6b89614 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:01.978129 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8a55be2b-98fe-4201-be4f-0671e6b89614 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:01.978932 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8a55be2b-98fe-4201-be4f-0671e6b89614 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:01.979374 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-8a55be2b-98fe-4201-be4f-0671e6b89614 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:02.108692 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-8a55be2b-98fe-4201-be4f-0671e6b89614 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:02.116653 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-8a55be2b-98fe-4201-be4f-0671e6b89614 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1555 microversion: 2.1 time: 0.150441 Jun 16 19:12:02.117215 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 613/1188] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:01 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:02.972487 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [req-8dbdb2c0-6da1-4d75-a120-ad4407402c4b req-69af54d5-8542-4317-815f-bd58e32cf1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1348675e-c712-4fef-bfa2-055adc5e73b7", "name": "network-vif-deleted", "tag": "efca7ecf-770c-43f6-ad48-76e41bcc8e51"}]} {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:02.980997 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-8dbdb2c0-6da1-4d75-a120-ad4407402c4b req-69af54d5-8542-4317-815f-bd58e32cf1c8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:02.981502 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [req-8dbdb2c0-6da1-4d75-a120-ad4407402c4b req-69af54d5-8542-4317-815f-bd58e32cf1c8 service nova] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:02.992307 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.compute.server_external_events [req-8dbdb2c0-6da1-4d75-a120-ad4407402c4b req-69af54d5-8542-4317-815f-bd58e32cf1c8 service nova] Creating event network-vif-deleted:efca7ecf-770c-43f6-ad48-76e41bcc8e51 for instance 1348675e-c712-4fef-bfa2-055adc5e73b7 on hv-cinder-84617 Jun 16 19:12:02.997055 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [req-8dbdb2c0-6da1-4d75-a120-ad4407402c4b req-69af54d5-8542-4317-815f-bd58e32cf1c8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028829 Jun 16 19:12:02.997642 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 576/1189] 10.222.0.81 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:12:03.134594 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-d14de482-5952-43fa-a5cd-8e07b82d66a0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:03.135736 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.compute.api [None req-d14de482-5952-43fa-a5cd-8e07b82d66a0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130229) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:03.142983 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d14de482-5952-43fa-a5cd-8e07b82d66a0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:03.143432 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d14de482-5952-43fa-a5cd-8e07b82d66a0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:03.144201 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d14de482-5952-43fa-a5cd-8e07b82d66a0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:03.144640 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG oslo_concurrency.lockutils [None req-d14de482-5952-43fa-a5cd-8e07b82d66a0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130229) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:03.208518 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.policy [None req-d14de482-5952-43fa-a5cd-8e07b82d66a0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a52eccb2ea4b4920863f4e74e75296ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434965eee025410ca595f90a8bd80ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130229) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:03.216169 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-d14de482-5952-43fa-a5cd-8e07b82d66a0 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 200 len: 1344 microversion: 2.1 time: 0.085703 Jun 16 19:12:03.216734 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 614/1190] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:03 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 1344 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:04.233917 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-fc13be41-32bf-407c-a98b-94a1f4ee3f18 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '>' {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:04.235225 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.compute.api [None req-fc13be41-32bf-407c-a98b-94a1f4ee3f18 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] [instance: 1348675e-c712-4fef-bfa2-055adc5e73b7] Fetching instance by UUID {{(pid=130230) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:04.241446 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fc13be41-32bf-407c-a98b-94a1f4ee3f18 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:04.241901 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fc13be41-32bf-407c-a98b-94a1f4ee3f18 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:04.242670 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fc13be41-32bf-407c-a98b-94a1f4ee3f18 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:04.243112 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG oslo_concurrency.lockutils [None req-fc13be41-32bf-407c-a98b-94a1f4ee3f18 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Lock "09ff3e34-0387-4a9f-a89a-c712eae3ab25" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130230) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:04.256640 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.wsgi [None req-fc13be41-32bf-407c-a98b-94a1f4ee3f18 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] HTTP exception thrown: Instance 1348675e-c712-4fef-bfa2-055adc5e73b7 could not be found. Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-fc13be41-32bf-407c-a98b-94a1f4ee3f18 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Request method failure captured: Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: request: GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 HTTP/1.1 Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept: application/json Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Accept-Encoding: identity Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Connection: close Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Length: 0 Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Content-Type: application/json Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Host: 10.222.0.81 Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Openstack-System-Scope: None Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: User-Agent: python-urllib3/1.26.9 Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Auth-Token: gAAAAABiq4AH-Q_7nfgUMvsVHgg5ReNAsRcKc8Qnifkq_1Aaw89BWY-1T0Wif_6B9z18Qv4XGD2Of3Nhk2yCUD_mTc3xYZeCubbtFl4hjYZjPX4wK6nzMef5pWzSFCrNwQ-kPhPCg453uxEioUfNpZxXYcAC-psYduMYYRZrdNuABDnOWu2rn6A Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Id: None Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Domain-Name: None Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Identity-Status: Confirmed Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Is-Admin-Project: True Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Id: default Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Domain-Name: Default Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Id: 434965eee025410ca595f90a8bd80ee5 Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Project-Name: tempest-TestMinimumBasicScenario-403167475 Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Role: member,reader Jun 16 19:12:04.258292 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Roles: member,reader Jun 16 19:12:04.260046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/434965eee025410ca595f90a8bd80ee5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81:8080/v1/AUTH_434965eee025410ca595f90a8bd80ee5", "adminURL": "http://10.222.0.81:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/volume/v3/434965eee025410ca595f90a8bd80ee5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.81/compute/v2/434965eee025410ca595f90a8bd80ee5"}]}] Jun 16 19:12:04.260046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant: tempest-TestMinimumBasicScenario-403167475 Jun 16 19:12:04.260046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Id: 434965eee025410ca595f90a8bd80ee5 Jun 16 19:12:04.260046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-Tenant-Name: tempest-TestMinimumBasicScenario-403167475 Jun 16 19:12:04.260046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User: tempest-TestMinimumBasicScenario-403167475-project Jun 16 19:12:04.260046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Id: default Jun 16 19:12:04.260046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Domain-Name: Default Jun 16 19:12:04.260046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Id: a52eccb2ea4b4920863f4e74e75296ab Jun 16 19:12:04.260046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: X-User-Name: tempest-TestMinimumBasicScenario-403167475-project Jun 16 19:12:04.260046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: method: > Jun 16 19:12:04.260046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: exception: Instance 1348675e-c712-4fef-bfa2-055adc5e73b7 could not be found. Jun 16 19:12:04.260046 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: action_args: {'id': '1348675e-c712-4fef-bfa2-055adc5e73b7'} Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: {{(pid=130230) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1348675e-c712-4fef-bfa2-055adc5e73b7 could not be found. Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:12:04.261156 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1348675e-c712-4fef-bfa2-055adc5e73b7 could not be found. Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1348675e-c712-4fef-bfa2-055adc5e73b7 could not be found. Jun 16 19:12:04.262838 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: ERROR nova.api.openstack.wsgi Jun 16 19:12:04.264383 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: DEBUG nova.api.openstack.wsgi [None req-fc13be41-32bf-407c-a98b-94a1f4ee3f18 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Returning 404 to user: Instance 1348675e-c712-4fef-bfa2-055adc5e73b7 could not be found. {{(pid=130230) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:12:04.264383 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO nova.api.openstack.requestlog [None req-fc13be41-32bf-407c-a98b-94a1f4ee3f18 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7" status: 404 len: 111 microversion: 2.1 time: 0.030464 Jun 16 19:12:04.264383 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: [pid: 130230|app: 0|req: 577/1191] 10.222.0.81 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:04 2022] GET /compute/v2.1/servers/1348675e-c712-4fef-bfa2-055adc5e73b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:12:04.268934 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: DEBUG nova.api.openstack.wsgi [None req-286762ef-c758-4113-bf90-e3edccf5cc71 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] Calling method '.version_select at 0x7f2018899280>' {{(pid=130229) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:04.337169 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO nova.api.openstack.requestlog [None req-286762ef-c758-4113-bf90-e3edccf5cc71 tempest-TestMinimumBasicScenario-403167475 tempest-TestMinimumBasicScenario-403167475-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1336293055" status: 202 len: 0 microversion: 2.1 time: 0.072052 Jun 16 19:12:04.337774 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: [pid: 130229|app: 0|req: 615/1192] 10.222.0.81 () {58 vars in 1271 bytes} [Thu Jun 16 19:12:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1336293055 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:12:49.524880 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:12:49.525421 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Thu Jun 16 19:12:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:12:49.585071 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:12:49.585559 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Thu Jun 16 19:12:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:14:19.878331 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:14:19.878920 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Thu Jun 16 19:14:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:14:30.309881 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:14:30.310346 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Thu Jun 16 19:14:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:14:43.881653 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:14:43.882304 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Thu Jun 16 19:14:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:14:46.140168 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:14:46.140780 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Thu Jun 16 19:14:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:16:09.532587 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:16:09.533228 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Thu Jun 16 19:16:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:16:09.592625 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:16:09.593141 dv-cinder-846171-1-iscsi devstack@n-api.service[130229]: Thu Jun 16 19:16:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:17:39.886580 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:17:39.887220 dv-cinder-846171-1-iscsi devstack@n-api.service[130230]: Thu Jun 16 19:17:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!